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ABSTRACT 


This  report  involves  the  application  of  ideas  in  adaptive  stochastic 
control  to  economics. 

We  investigate  the  control  problem  for  a linear,  multivariable,  dynamic 
system  with  purely  random  (i.e.  white)  parameters.  The  quadratic  cost 
criterion  is  formulated  to  make  the  problem  a tracking  problem.  Since  the 
parameters  are  modelled  as  white  stochastic  processes,  there  is  no 
posterior  learning  and  no  dual  effect.  The  certainty-equivalence  principle 
does  not  hold.  We  find  that  the  extension  of  the  "Uncertainty  Threshold 
Principle"  from  scalar  systems  to  multidimensional  ones  turns  out  to  be 
analytically  intractable. 

Next,  we  derive  sensitivity  equations  for  the  above  optimal  system  to 
study  the  effects  of  small  variations  in  parameter  uncertainties  on  the 
optimal  performance  of  the  system.  These  equations  enable  us  to  rank 
parameters  in  order  of  the  sensitivity  of  the  performance  to  variations 
in  their  variances.  This  makes  it  possible  to  locate  the  "pressure" 
points  in  a model,  if  any  exist. 

We  then  convert  an  economic  policy  problem  into  a stochastic  optimal 
control  tracking  problem  and  analyse  it  with  the  equations  we  have  derived. 
We  study  the  different  elements  that  enter  into  a tracking  problem  and 
then  discuss  the  empirical  results  obtained  from  the  sensitivity  equations. 
The  model  we  choose  for  the  analysis  turns  out  to  be  insensitive  to 
variations  in  parameter  variances  which  makes  it  reasonably  reliable. 

We  also  analyse  in  detail  the  structure  of  the  model  and  the  inter- 
dependences of  the  state  and  control  variables. 

General  purpose  computer  programs  are  included  in  one  of  the  appendices. 
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CHAPTER  1 
INTRODUCTION 

1.1  Adaptive  Stochastic  Control  : 

Though  research  in  stochastic  control  has  progressed  in  the  last 
decade,  there  does  not  exist  at  present  a general,  computationally  viable 
theory  of  optimal  stochastic  control.  Richard  Ku,  in  his  doctoral  thesis 
[1],  gives  a survey  of  this  area.  Bellman  [2]  first  introduced  the 
concepts  of  'information  pattern'  and  'learning'.  Feldbaum  [3]  expanded 
on  this  in  his  celebrated  four  part  paper  on  the  theory  of  dual  control, 
in  which  he  identified  the  two  distinct  roles  an  optimal  controller  must 
play  to  be  truly  optimal.  The  controller  must  actively  try  to  identify 
the  unknown  parameters  of  the  system  and  simultaneously  try  to  control  the 
system.  He  showed  that  in  such  dual  control  systems  there  may  exist  an 
inherent  conflict  between  applying  the  inputs  for  learning  and  for 
effective  control  purposes.  This  introduced  the  concepts  of  caution  and 
probing  and  the  possible  trade-off  between  them.  For  some  insight,  the 
reader  might  want  to  refer  to  a paper  by  Stemby  [4]  , in  which  he  solves 
a simple  dual  control  problem  analytically  and  compares  the  optimal 
solution  with  other  suboptimal  strategies. 

Bar-Shalom  and  Tse  have  further  clarified  the  concept  of  dual 
control  and  various  related  concepts  like  separation,  certainty- 
equivalence,  neutrality  and  have  also  made  precise  the  subtle  differences 
between  closed-loop  optimal  policies  and  feedback  optimal  policies 
arising  from  different  information  patterns.  These  can  be  found  in 
[5]  - [9].  On  the  last  point  there  is  an  excellent  paper  by  Dreyfus  [10], 
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Since  the  permissible  controls  are  causal,  the  only  information 
about  future  observations  that  can  be  used  by  the  controller  is  the 
probability  distribution  of  these  future  observations.  This  knowledge 
is  what  makes  the  difference  between  a feedback  control  policy  and  a 
closed-loop  control  policy.  It  is  only  the  latter  policy  that  uses  this 
information  to  advantage.  The  feedback  law  at  time  t uses  information 
only  upto  time  t.  And  it  is  this  difference  that  makes  the  dual  effect 
possible.  A control  is  said  to  have  a dual  effect  when,  in  addition  to 
its  effect  on  the  state  of  the  system,  it  is  able  to  affect  the 
uncertainty  of  the  state  of  the  system.  If  the  control  cannot  affect 
this  uncertainty,  then  the  system  is  called  neutral.  If  the  dual  effect 
is  present,  then  the  control  can  help  to  improve  the  future  estimation 
and  in  so  doing  facilitate  the  task  of  the  control.  In  this  case  the 
control  is  said  to  be  actively  adaptive.  Precise  definitions  of  these 
terms  can  be  found  in  the  references  cited  above. 

It  turns  out,  however,  that  we  cannot  solve  the  adaptive  control 
problem  except  for  special  cases.  In  fact,  the  decision  problem  in 
linear  systems  with  unknown  parameters  is  actually  a nonlinear  stochastic 
control  problem  [7],  [47].  There  are  two  ways  in  which  we  can  make 
approximations  to  make  the  original  problem  mathematically  tractable. 

','ne  is  to  approximate  the  optimal  law.  The  second  is  to  approximate  the 
linear  system  as  having  random  parameters  that  are  uncorrelated  in  time, 
or  white,  in  engineering  jargon,  and  to  obtain  the  optimal  control  for 
this  approximate  system  which  may  now  be  possible  analytically.  This  is 
the  route  we  shall  take  in  this  report.  We  shall  find  that  our 
assumption  of  white  parameters  makes  identification  impossible  which  means 
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there  is  no  probing  action  thereby  making  the  problem  solvable. 

!_  Before  we  turn  to  a mathematical  description  of  the  problem,  let 

us  first  survey  the  interactions  of  control  theory  and  economics,  as  we 
shall  be  applying  our  techniques  to  an  economic  policy  problem. 

1.2  Control  Theory  and  Economics  : 

In  recent  years,  several  workers  have  begun  to  find  the  techniques 
of  optimal  control  theory  to  be  useful  to  the  analysis  of  economic 
problems.  Some  of  the  basic  concepts  of  system  theory  and,  in  particular, 
of  stochastic  optimal  control  theory  may  be  able  to  provide  a more  unified 
and  comprehensive  analytical  framework  for  posing  and  solving  economic 
problems.  Kendrick  £12] , Athans  and  Kendrick  [13],  and  Aoki  [14J  have 
written  good  survey  articles  with  extensive  bibliographies  on  the 
different  areas  of  interaction  between  economists  and  control  theorists. 
The  earliest  instances  of  such  intercourse  began  to  appear  in  the  1950's 
with  the  work  of  Tustin  [15],  Phillips  [16],  Theil  [17]  and  Simon  [18]. 
After  this,  there  seems  to  have  been  a total  absence  of  dialogue  until 
the  1970's.  This  decade  has  seen,  however,  an  encouragingly  large 
number  of  interactions.  Aoki,  Chow,  Kendrick  and  Pindyck,  amongst 
others,  seem  to  have  been  the  more  prominent  contributors,  [19]  - [38]. 
Though  there  is  still  a debate  about  the  degree  and  kind  of  applicability 
of  control  theoretic  ideas  and  methods,  it  is  significant  that  the  debate 
does  not  question  any  more  the  fact  of  the  basic  usefulness  of  control 
theory  to  economics.  One  cannot  emphasize  enough,  however,  the  need 
for  control  theorists  to  thoroughly  understand  the  economics  they  wish 
to  apply  themselves  to.  Also,  economists  would  do  well  to  appreciate 
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the  different  tools  developed  in  control  theory  together  with  the 
limitations  of  these  tools. 

The  applications  of  control  theory  have  been  in  different  areas  of 
economics  : various  microeconomic  problems  and  macroeconomic  stabilization 
and  regulation  problems.  Examples  of  microeconomic  applications  are 
profit  maximization  in  a firm,  optimal  advertizing  levels,  analysis  of 
commodity  markets,  optimal  price  setting  in  the  face  of  uncertain  consumer 
response,  and  others,  all  in  a more  general  dynamic  setting.  The  reader 
can  find  references  in  the  survey  articles  cited  above  and  in  [38J . 

A natural  area  for  control  applications  is  the  analysis  of 
macroeconomic  policy  planning  problems.  Economic  policymakers  are 
interested  in  controlling  the  national  economy  with  the  various  instruments 
they  have  at  their  disposal.  The  economy  is,  firstly,  a dynamic  entity, 
in  which  present  policy  action  affects  not  only  the  present  but  also  the 
future  course  of  events.  Secondly,  it  is  essentially  a stochastic  entity 
as  well,  so  that  some  way  of  incorporating  uncertainty  at  a basic  level 
is  needed.  This  makes  the  regulation  of  the  economy  a natural  stochastic 
control  problem. 

A number  of  questions  arise  in  the  evaluation  of  the  performance 
of  the  economy  under  different  specifications  of  the  policy  instruments. 
First  of  all,  we  need  to  specify  goals  in  terms  of  which  this  performance 
can  be  evaluated.  Once  we  have  succeeded  in  formulating  clearly  our 
objectives,  how  do  we  look  for  good  policies?  In  general,  one  might 
expect  a good  policy  to  coordinate  all  the  available  instruments  in  some 
suitable  way.  How  do  we  compare  different  "good"  policies?  Is  there  an 
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unique  optimal  policy?  Many  other  related  questions  can  be  asked. 

Optimal  control  seems  to  offer  a natural,  precise  framework  for  addressing 
such  questions. 

Another  point,  in  a slightly  different  vein,  needs  to  be  made 
here.  System  theory  can  make  a far  more  basic  contribution  as  well.  Much 
conventional  economics  is  done  in  a sociopolitical  vacuum  from  which  all 
traces  of  conflict,  compromise,  imbalances  of  power,  human  factors  in 
policymaking  and  other  so-called  imperfections  have  been  conveniently 
removed.  If  one  is  to  adopt  a realistic  approach  to  real  problems,  then 
a more  comprehensive  viewpoint  at  a fundamental  level  is  needed,  and  to 
the  extent  that  science  can  illuminate  our  understanding  of  human 
"systems",  system  theory  has  the  potential  to  incorporate  a larger  view. 
(This,  of  course,  is  not  to  ratify  the  argot  in  the  pseudosciences  of 
"General  Systems  Theory"  [39]  or  "System  Dynamics"  [40].) 

Economists  and  control  theorists  approach  their  models  with 
different  attitudes  and  this  has,  to  some  degree,  influenced  the  tools 
they  use.  In  economics,  many  aspects  of  the  models  are  rather  arbitrary 
since  the  sheer  complexity  of  real  economic  phenomena  force  model 
builders  to  adopt  many  simplifying  and  often  unrealistic  assumptions  for 
reasons  not  entirely  justifiable  on  economic  considerations  alone.  This 
is  in  addition  to  the  fact  that  economic  theory  today  does  not  as  yet 
have  a really  fundamental  grasp  of  economic  phenomena.  Conscious  of  this 
arbitrariness  to  some  extent,  economists  do  not  take  their  models 
literally  and  are  generally  content  with  establishing  qualitative 
properties  of  their  models  such  as  existence  of  optimal  decision  rules 
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and  properties  of  classes  of  optimal  decision  rules  such  as  stationarity 
and  stability.  Time  has  played  a relatively  minor  role  in  these  models, 
though  recent  economics  has  considered  it  more  adequately. 

Engineers,  on  the  other  hand,  do  have  a better  and  deeper 
understanding  of  the  engineering  systems  they  model,  relatively  speaking, 
and  so  tend  to  trust  their  models  to  a far  greater  degree.  They  generally 
analyse  their  systems  in  detailed  quantitative  terms,  and  construct  and 
implement  algorithms  for  optimal  decision  rules,  in  addition  to  studying 
the  qualitative  features  of  their  systems.  Most  models  do  take  into 
account  the  dynamics  of  the  system. 

The  focal  point  of  the  interaction  here  has  been  the  traditional 
macroeconometric  model  which,  after  suitable  transformation,  can  be 
recast  into  the  state-space  representation  familiar  to  engineers. 
Economists  usually  assume  that  the  main  state  variables  can  be  measured 
exactly.  Also,  they  emphasize  the  estimation  of  unknown  parameters. 
Engineers,  on  the  other  hand,  usually  take  parameters  as  given  and  deal 
with  observation  errors  instead.  In  [31]  , Kendrick  observes  that  the 
data  used  by  policy  analysts  to  determine  monetary  and  fiscal  policies 
are  known  to  contain  errors.  Such  data  are  being  constantly  revised  as 
more  information  becomes  available.  The  magnitude  of  these  revisions 
gives  us  a measure  of  the  relative  quality  of  different  macroeconomic 
time  series.  However,  economists  do  not  at  present  use  this  new 
information  in  determining  policies.  Fair  [11]  points  out  that  the 
accuracy  of  the  model  is  generally  improved  when  the  actual  values  of  the 
exogenous  variables  are  used  and  when  more  recent  coefficient  estimates 
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are  used.  From  the  engineering  side,  adaptive  control  algorithms  that 
look  impossible  in  an  aerospace  context  may  be  perfectly  practical  when 
decision  rules  have  to  be  computed  only  once  a month  or  once  every  quarter. 

Differences  of  this  kind  in  attitude  and  approach  help  to  underscore, 
in  fact,  the  common  thread  that  binds  both  fields  : the  making  of  decisions 
with  imperfect  information  in  an  uncertain  environment.  Adaptive 
stochastic  control  seeks  to  tackle  this  basic  question.  Let  us  turn  now 
to  a mathematical  formulation  of  the  problem. 


1 . 3 The  Problem  : 

We  shall  study  the  following  linear,  multivariable,  discrete-time 
system  : 


Vi  ■ Vt  * Btut  * ct 


(1.3.1) 


where  At»Bt  are  white,  Gaussian  matrices  and  c^  is  a white,  Gaussian 
vector.  Note  that  the  noise  in  this  system  enters  both  additively,  through 
c^ , and  multiplicatively  through  and  Bt.  Note  also  that  all  the 
random  quantities  are  white.  This  is  a crucial  assumption  in  that  it 
makes  active  learning  impossible  since,  at  each  time  instant,  the  values 
of  A,  B and  C are  all  uncorrelated  with  the  past.  However,  this 
assumption  does  enable  us  to  deal  analytically  with  uncertain  parameters, 
representing  in  some  sense  a worst  case  situation.  The  assumption  of  a 
Gaussian  distribution  is  actually  superfluous.  All  we  need  to  know  are 
the  first  and  second  order  statistics.  The  actual  probability  distribution 


does  not  matter. 
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This  formulation  holds  a double  interest.  Firstly,  its  solution 
i-  is  of  basic  theoretical  interest.  An  analysis  of  this  problem  can  be 

found  in  [1],  [41],  [42],  [43].  This  system  forms  the  basis  of  the 
result  embodied  in  the  "Uncertainty  Threshold  Principle"  expounded  in 
[1],  [44],  [45],  [46].  The  second  point  of  this  formulation  is  that  its 
assumptions  fit  the  framework  of  linear  econometric  models  reasonably 
well.  The  estimated  parameters  of  econometric  models  are  actually  random 
variables.  The  use  of  white  processes,  of  course,  may  not  be  quite 
realistic,  though  this  assumption  makes  the  problem  amenable  to  mathe- 
matical solution,  and  in  addition  represents  a worst  case  situation 
which  may  yield  useful  information  for  further  analysis. 

The  central  result  of  Ku's  thesis  [1]  that  is  of  relevance  to  us 
is  embodied  in  what  is  called  the  "Uncertainty  Threshold  Principle". 

It  arises  from  an  analysis  of  the  following  scalar  stochastic  control 
problem  : 

Vl  = atxt+btut+5t;  xo  given  Cl.  3. 2) 

where  x^  is  the  scalar  state  of  the  first  order  system.  We  assume  that 
the  driving  term  is  a zero-mean  Gaussian  white  noise  with  known 
variance  5.  We  also  assume  that  the  random  parameters  and  bt  are 

Gaussian  and  white  with  known  means  a,  b,  known  variances  I , E , 

cLc 1 Du 

and  known  cross-covariance  I . . We  also  have  perfect  state  information. 

ab 

The  optimal  control  problem  is  to  find  a feedback  control  law 
ut  31  y(xt,t),  t = 0,1,2,  ...  , N-l,  such  that  the  expected  value  of  the 
following  quadratic  cost  functional  is  minimized. 
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N-l 

J-  E { QXM  + I (Qx*  + Ru2)  } , F,Q^O,  R > 0 (1.3.3) 

t=0 


The  expectation  is  taken  with  respect  to  the  probability  distribution  of 
the  underlying  random  variables  at,  bt>  5t- 


The  solution  to  this  problem  is  readily  obtained  by  applying  the 
standard  stochastic  dynamic  programming  algorithm.  We  get  the  following 
equations  : 


★ 


- Gt 

X 

t 

(1 

.3.4) 

Kt+1 

< Eab 

+ ab) 

(1 

.3.5) 

R + 

< Ebb  + 

B2>  Kt+i 

Q ♦ 

^ Eaa 

a2)Kt+i-G2[R+Kt+i(Zbb+b2)] 

Cl. 

.3.6) 

O' 

(1. 

,3.7) 

The  optimal  cost  is  given  by  : 


J 


K x2 
o o 


+ 


N-l 


l 

1=0 


(1.3.8) 


We  note,  in  passing,  that  the  control  law  is  linear  in  the  state  and  the 
Riccati-like  equation  satisfied  by  Kt  has  a unique  solution  under  the  given 
conditions . 


An  inspection  of  the  infinite  horizon  case  (N -*•«>)  yields  an 
interesting  result.  Assume  that  K ^ is  "large"  in  the  following 
equation  : 


( E ♦ a2) 
v aa  ' 


't  + 1 


(Iab 


♦ ai>)2 


R ♦ (Tbb  ♦ b2)  K, 


t + 1 


j 

| 

1 

i 

i 
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Then  the  backward  in  time  evolution  of  Kt  is  given  approximately 

Kt  * W M 

(Z  + ab)2 

where  M = E ♦ a2 — (1.3.9) 

(Zbb  + ^ 

Clearly,  if  the  threshold  parameter  M>1,  then  Kt  blows  up.  In 
fact,  it  is  possible  to  prove  that  the  unique  positive  solution  to  the 
above  equation  exists  if  and  only  if  M<1.  This  result,  which  imposes 
a fundamental  limitation  on  the  infinite  horizon  problem,  is  called  the 
Uncertainty  Threshold  Principle.  If  M > 1,  then  blows  up  and  therefore 
the  optimal  cost  J*  also  blows  up.  In  physical  terms,  this  principle 
makes  the  eminently  reasonable  statement  that  if  one’s  knowledge  about 
the  present  and  future  structure  of  the  system  is  "very"  uncertain,  then 
there  is  no  optimal  action  that  will  keep  the  cost  finite  for  the  infinite 
horizon  problem.  Though  the  result  has  been  proved  for  linear-quadratic 
systems, it  seems  reasonable  to  assume  the  same  qualitative  result  for 
general  systems  too. 

1 . 4 Structure  of  Report  : 

In  this  report  we  shall  pursue  two  different  routes  that  arise 
from  the  random  parameter  formulation.  The  first  is  to  extend  the  above 
described  result  to  multivariable  systems.  This  turns  out  to  be  far  more 
difficult  than  what  it  may  seem  to  be  on  first  sight.  The  equations, 
though  similar  in  structure,  are  far  more  complicated  because  of  the 
appearance  of  matrices  in  all  the  formulas.  The  first  difficulty  one  faces 
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is  the  question  of  suitably  representing  the  covariance  of  a matrix  and 
then  establishing  formulas  and  equations  that  are  expressed  in  terms  of 
the  means  and  covariances  of  the  various  matrices.  We  find  that  it  is 
very  difficult,  if  not  impossible,  to  derive  an  analytical  formula  for 
the  threshold  in  analogy  with  the  scalar  case.  This  part  of  the  work  is 
described  in  Chapter  2. 

The  second  route  is  more  practically  oriented.  We  know  that  it 
is  difficult  to  control  large  econometric  models  with  many  random 
parameters.  If  we  formulate  the  policy  problem  in  an  optimal  control 
framework,  then  it  would  be  very  useful  if  we  could  develop  some  method 
by  which  to  rank  these  parameters  in  terms  of  their  influence  on  the 
performance  of  the  system.  This  would  tell  us  which,  if  any,  parameters 
are  sensitive  and  give  a clue  as  to  whether  better  information  is  needed 
if  we  are  to  trust  the  model  we  are  using.  This  kind  of  study  falls  under 
the  general  rubric  of  sensitivity  analysis.  A fair  amount  of  work  has 
already  been  done  in  this  area,  [48]  - [63],  and  this  methodology  can  be 
readily  applied  to  derive  equations  for  our  case.  We  first  derive 
sensitivity  equations  for  optimal  random  parameter  systems.  Next  we 
choose  a small  econometric  model  by  Abel  [47]  and  apply  these  equations 
to  the  model.  We  then  analyse  the  results  and  comment  on  possible  uses 
for  this  approach.  This  is  the  content  of  Chapters  3 and  4. 

1. 5 Contributions  of  the  Report  : 

1.  Derivation  and  analysis  of  the  solution  to  the  optimal 
linear  - quadratic  tracking  problem  with  purely  random 
parameters  and  additive  noise. 


* 


i 
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Sensitivity  analysis  : development  of  sensitivity  equations 
for  the  above  system  to  rank  parameters  in  terms  of  their 
influence  on  the  performance  of  the  system. 

Application  of  above  equations  to  a simple  macroeconomic 
model  of  the  U.S.  economy. 

Development  of  general  purpose  computer  programs  for  the 
optimal  stochastic  control  of  multivariable  linear  systems 
with  white  parameters  with  respect  to  quadratic  performance 
criteria,  for  both  regulator  and  tracking  applications. 
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CHAPTER  2 

OPTIMAL  LINEAR  RANDOM  PARAMETER  SYSTEMS 

2. 1 Introduction  : 

In  this  chapter,  we  shall  develop  and  discuss  the  optimal  control 
problem  for  linear  systems  with  purely  random  parameters.  We  treat  the 
most  general  case  of  this  formulation  : the  problem  is  multivariable  and 
includes  additive  noise,  and  is  stated  as  a tracking  problem.  We  also 
state  the  'Uncertainty  Threshold  Principle'  for  one-dimensional  systems 
and  consider  some  of  the  difficulties  involved  in  trying  to  extend  it  to 
multivariable  systems.  Here  we  present  one  way  of  representing 
algebraically  the  solution  to  the  multivariable  control  problem.  Some 
empirical  results  are  presented  to  demonstrate  the  behaviour  of  such 
systems.  This  chapter  will  try  to  lay  the  groundwork  and  motivation  for 
the  next  chapter. 

In  the  next  section,  we  state  the  problem  as  a multivariable 
linear  - quadratic  random  parameter  tracking  problem.  In  section  3, 
we  present  the  solution  of  the  problem.  Since  the  actual  derivation  is 
slightly  long  and  complicated  we  choose  to  present  it  in  Appendix  A. 

In  section  4,  we  discuss  the  solution  of  the  problem.  Next,  in  section 
5,  we  demonstrate  the  Uncertainty  Threshold  Principle  developed  by 
Ku  [ 1 ] for  further  insight  into  the  problem. 
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2.2  Problem  Statement  : 


Let  us  begin  by  stating  the  problem.  Consider  a multivariable 
stochastic  linear  dyncmical  system  with  state  x and  control  u 
described  by  the  following  difference  equation  : 


xt+i  = -t-t  + -t-t  + £t 


(2.2.1) 


xq  given;  t = 0,1,2,  ...  , N-l 


nn  nm  . nn*n  _ r,nxm  „ nn 

e R , u^  e R , e R , B e R , £t  g R 


Henceforth  we  shall  not  underscore  vectors  or  matrices  for  greater 
clarity  of  notation.  We  assume  that  the  additive  term  c driving  the 
system  is  a vector  random  process  which  is  white  and  whose  mean  vector 
and  covariance  matrix  are  given.  That  is,  we  assume  that 


E { ct } = c Vt 

E { (ct  - c)  (cT-  c)'}  = Zc6tx 


1 if  t = T 
0 if  t / T 


where  E is  an  n * n matrix, 
c 

Assume  that  and  are  random  matrices  which  are  also  white  with 
given  first  and  second  order  statistics.  We  assume  that 

E { At  } = A 
E { Bt  } ■ B 

Here  we  face  the  issue  of  how  to  represent  the  covariance  of  a matrix. 
Just  as  the  covariance  of  a vector  is  a matrix,  so  the  covariance  of  a 
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matrix  is  a fourth-order  tensor.  We  can,  however,  express  this  tensor 

as  a higher  dimensional  matrix.  There  are  many  ways  of  doing  this,  an  j 

obvious  one  that  comes  to  mind  immediately  being  the  Kronecker  product. 

The  manner  of  representation  should  evidently  be  dictated  by  how  we  wish  • 

to  use  the  covariance.  We  shall  find  that,  for  our  purposes,  the  most  < 

suitable  representation  is  obtained  by  using  the  simple  notion  of  a ^ 

stacking  operator,  that  is,  an  operator  that  stacks  the  columns  of  a 
matrix  into  a single  vector.  Mathematically,  if  we  have  a p x q matrix  A 
whose  columns  are  denoted  by  a^  i.e. 

if  A = (aj  a2  a3  aq) 

then  S (A)  = 

stacks  the  columns  of  A into  a single  vector  of  length  pq. 

The  definition  of  covariance  now  follows  quite  readily  : 

Cov  (A)  = E { [ S(At)  - S (A) ] [ S(At)  - S(A)]'  } 

An  immediate  advantage  of  this  representation  vis-a-vis  the  Kronecker 
product  is  that  it  is  symmetric. 

To  return  to  our  problem,  we  assume  that 

E { [ S(At)  - S (A)  ] [ S(AX)  - S (A)  ]•}  = Ea  6tT 

E { [ S(Bt)  - S (B)  ] [ S(Bt)  - S (B)  ]'}  = 6^ 

E { [ S(Bt)  - S(§)  ] [ S(At)  - S (A)  ]'}  = Era  5tx 


23 


We  also  assume  that  the  following  cross-covariances  are  given  : 

E { [ S(At)  - S (A)  ] [ - c ]•}  = EAc  5tT 

E { [ S(Bt)  - S(B)  ] [ cT  - c ]•}  - J:Bc  <StT 

All  the  covariance  matrices  must,  of  course,  be  positive  semi-definite. 

In  addition  to  this,  they  must  also  satisfy  the  constraint  that  the 

correlation  coefficient  for  each  pair  of  parameters  must  lie  between  -1 
and  +1.  Note  that  all  the  given  statistics  are  time- invariant  - this 
is  not  really  a restriction.  The  generalization  to  the  nonstationary 
case  is  immediate.  Note  also  that  we  have  made  no  assumptions  about  the 
actual  distributions  of  the  various  random  parameters. 

For  any  optimal  control  problem,  it  is  essential  to  specify  the 
information  available  for  control,  that  is,  the  information  pattern. 
Generally,  in  stochastic  control  problems,  utilizing  observations 
improves  the  performance  over  the  open  loop  controls  because  using 
measurements  on  the  system  allows  one  to  reduce  the  uncertainty.  A 
causal  or  non-anticipative  control  cannot  obviously  use  future 
observations,  but  it  can,  however,  use  the  given  a priori  information 
about  the  future  probabilistic  behaviour  of  the  system  and  measurement 
dynamics,  or,  in  equivalent  terms,  it  can  use  a probabilistic  description 
of  future  observations. 

For  our  formulation  of  the  problem,  the  information  pattern  is 
especially  simple.  The  whiteness  of  each  component  of  noise,  multi- 
plicative as  well  as  additive,  in  the  system,  makes  any  learning 
impossible,  and  so  renders  the  control  law  incapable  of  affecting  future 
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uncertainty.  The  law  does,  of  course,  take  present  uncertainty  into 
account. 

We  assume  perfect  state  measurements.  We  also  assume  that  the 
admissible  controls  are  real-valued  and  of  state  feedback  type, 

*ut  = y (xt,t)',  such  that  they  depend  only  on  the  given  a priori 
information  and  measurements  upto  time  t. 

The  optimal  control  problem,  then,  is  to  determine  the  control 
sequence  ' u^  = Y(*t,t),  t = 0,1,2,  ...  , N-l  ',  that  minimizes 
the  following  quadratic  cost  criterion  : 

N-l 

J = ^ E4  o [Ut  ’ Xt)'Q(Xt  " Xt3  + (Ut  " V'R(ut  ' V] 

* (xN  - v,QCxn  - V > (2-2-2) 

where  (*t)  , {u^}  are  t^ie  tar§et  state  and  control  sequences 
respectively.  These  are,  of  course,  also  specified  at  the  beginning  of 
the  problem.  Thus,  the  problem  is  what  is  called  a 'tracking'  problem  in 
the  literature.  Note  that  the  weighting  matrices  are  taken  to  be 
constant  for  simplicity  but  the  generalization  to  time-varying  matrices 
is  quite  direct. 

We  now  proceed  to  solve  the  problem. 

2 . 3 Problem  Solution  : 

The  solution  to  the  optimal  control  problem  stated  above  can  be 
obtained  by  applying  the  method  of  stochastic  dynamic  programming.  Since 
the  complete  derivation  is  somewhat  lengthy,  we  shall  relegate  it  to 


* 
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Appendix  A and  merely  state  the  solution  here. 

The  control  law  turns  out  to  be  a linear  state  feedback  law,  as 
one  would  expect.  The  equations  are  : 

ut  = Ltxt  + (2.3.1) 

where  the  gain  Lt  is  given  by  : 

Lt  = - [ R + B'Kt+1B  ]_1  [ B'Kt+1A  ] (2.3.2) 

(We  use  the  notation  B'K  ^B  to  denote  E { B^K  ^8  } * etc.  See 
Appendix  A) 
and  where 

mt  = - [ R + B'Kt+1B  ]_1  [ B'Kt+1c  + I'Pt+1  - Rut]  (2.3.3) 

The  matrix,  , in  the  above  equations,  satisfies  the  following  Riccati- 
like  difference  equation  : 

Kt  = Q ♦ A'Kt+1A  + [ B'Kt+1A  ] • • Lt  (2.3.4) 

with  the  terminal  condition; 

Kj,  = Q (2.3.5) 

The  vector,  p^,  satisfies  the  following  equation  : 

Pt  = - Qxt  + A’Kt+1c  + A'pt+1  + [B'Kt+1A]'  •mt  (2.3.6) 

P.V  = * QXN 


The  optimal  cost  can  also  be  evaluated  and  turns  out  to  be  : 
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i-  x'Kx  + p'x  + g 
2 ooo  ro  o °o 


The  scalar  gQ  comes  from  the  following  difference  equation 


i *;Qxt  + iQ;Rat + ic'Kt+ic  + c,Pfi 


+ 2 [B'Kt+lC  + B'Pt+l  - RV  mt  + gt+l 


2 *N  Q*N 


The  state  of  the  optimal  system  is  now  given  by  : 


(2.3.8) 


(2.3.9) 

(2.3.10) 


Vi  = (At  + W xt  + Btmt  + ct  (2-3-n^ 

Since  x^  is  a random  variable,  so  is  the  control  u^,  though  the 
gain  Lt  and  the  driving  term  mt  are  deterministic. 

Note,  however,  that  our  a priori  information  is  in  terms  of  means 
and  covariances  of  At>  Bt  and  ct>  whereas  the  solution  is  expressed  in 
terms  of  certain  expectations  of  At , Bt>  c^.  We  should  like,  therefore, 
to  represent  the  solution  in  terms  of  the  various  means  and  covariances. 

As  these  equations  are  a bit  complicated,  let  us  first  look  to  the 
scalar  case  for  some  insight.  Let's  consider  the  scalar  system  : 


t*l 


atxt 


Vt 


(2.3. 12) 


where  af  , bt , c{  are  now  scalar  random  processes.  The  Riccati-like 
equation  for  the  scalar  is  : 


a ' K 


t *1 


UbK^i)  Lt 
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Lt  = - cR  + b2Kt+irlcabfW 

_ <ib  • + 2 

» Kt.i 


(2.3.13) 


Therefore, 


K 


t 


Q ♦ 


(at»2 

R + Kt+1 


But 

E { a2}  = E ♦ a2 
a 

E ( b2}  = L ♦ b2 
D 

E {ab}  = L + ab 
ba 

Hence 

Kt  " Q + ^ + 5X*1  - 


^ba  - 

R * (Zb  + b2)Kt+1 


(2.3.14) 


So  now  we  see  how  the  covariances  and  means  of  the  various  random 
parameters  directly  influence  the  evolution  of  Kt>  In  order  to  represent 
the  solution  to  the  multivariable  case  in  a similar  way  we  need  to  make  a 
few  definitions. 


(a)  ei  "v  a vector  of  appropriate  dimensions  with  all  zeroes  except 

for  a one  in  the  i-th  place. 

~ 0 " 

0 

ei  = i 

0 
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(b)  E^j  ^ a matrix  of  appropriate  dimensions  with  all  zeroes  except 
for  a one  in  the  i,j-th  place. 


(c)  ^ a block  matrix  with  n columns  and  an  appropriate  number 

2 

of  rows  (usually  either  n or  mn)  with  blocks  of  n*n  such  that 
the  k-th  block  is  the  identity  In,  and  the  rest  are  zeroes.  Here 
'n'  refers  to  the  number  of  states  and  'm'  to  the  number  of 
controls.  This  is  a generalization  of  e^. 


r kJl 

(d)  I n,  the  (k,£)-th  block  of  size  n*n  in  covariance  matrix 

A A 

A similar  definition  holds  for  cross-covariance  matrices  too. 


(e)  £ a,  the  fi,j)-th  element  of  the  (k,£)-th  block  of  Z.  i.e. 

A.  . A 

ij 

^A.  . E [ (aik  " aik^  (aj)l  " aj*.}  1 

ij 

Note  that,  from  the  above  definitions,  we  have. 


We  now  have  the  following  representation  : 


A'KA  = 

E { A'KA  } 

Proof  : 

L !.,trtukW  Ekt  * 

A'KA  = 

E { A’KA  } 

= 

E { ^(A'KA^^E^)  where  (A'KA)^  is  the 

element  of  (A'KA) 

= 

L E [ <A,KA>u  1 Ew 

But 

E [ (A,KA)k£  1 = E [ a'  Ka^  ] 

where  a^t  a^  are  the  k-th,  £-th  columns  of  A respectively. 


E 1 *i  ' E i l aik  Kij  ajt  i 

1 9 J 


' 1 Kii  £«*  * I a..K. .a., 

i.j  11  Aij  i.j  lk  15 


ki.  - 

= tr  K E*  + a£  Ka^ 


(2.3. 


£)-th 


(since  K is  symmetric) 
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Therefore, 


A'KA  ■ I tr  (KP'J  Pt)  Eu  . J 


n n 

I I tr  (KP'E  P ) E + A'KA 

k=l  £=1  k 


as  required 


The  same  expansion  holds  obviously  for  the  other  cases  as  well. 

Thus,  we  can  rewrite  the  solution  to  our  optimal  control  problem  in  the 


following  way 


Ltxt  + mt 


C2.3.16) 


111  1U 

-[«•!  I « <WiV«>  * S’Vi5  J'1 


k=l  2,  = 1 


m m 

‘ Ll  I."  ‘Vl'kWt  > Ekt  * 5' W 1 <2'3-17> 


- [ R . I l tr  (K^P-  IBPt)  Ek),  . B-K^jB]-1 


k=l  2=1 


1 tr  (Kt.ipkEBc>ek  * 5,w  * i,pt.i  - 1 


(2.3.18) 


Q * t |.i  I.  tr  (WAV  \i  * i,Kt*is  1 * 


‘ L L tr0tt*ipkVt)  em  - ''Vi*!'1. 


(2.3.19) 


QSt  * l « <Kt.lPiEAc)ek  * 5'KtM 


C * S'Pfl  * 


[ ^ tr  (V^Vk)  Ekl  * \ 


(2.3.20) 
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gt 

= 

1 

2 

x ' Q x + — u'  R u_ 
t x t 2 t t 

+ 

7 1 tr  »t.iV  * 'Vi'  J 

+ 

1 m t 

7 I l , " CRt-lpi  V ek  * -t 

k=l 

+ 

I f ®’Pt+l  - R5t  ] ’ mt  + gt+l 

(2.3.21) 

kn 

= 

Q 

(2.3.22) 

Pn 

= 

- 

q*n 

(2.3.23) 

gN 

= 

1 

2 

(2.3.24) 

* 

J 

= 

1 

2 

x'Kx  + p'x  +g 

OOO  0 0 0 

(2.3.25) 

2.4  Comments  : 

Let  us  briefly  note  some  of  the  salient  features  of  the  solution. 
Figure  2.1  shows  the  overall  structure  of  the  optimal  feedback  system. 
Since  u*  = + m^  , the  optimal  controller  is  a linear  and  time- 

varying  transformation  of  the  state.  This  is  so  even  if  the  system  is 
stationary  and  the  cost-functional  is  time- invariant . 

The  driving  term  ,mt'  in  the  control  performs  the  function  of 
neutralizing  the  mean  of  additive  noise  term  c^,  whereas  the  gain  Lt 
does  the  actual  steering  of  the  system,  as  can  be  seen  by  the  fact  that 
is  independent  of  ct.  Looking  at  Lt  more  closely,  we  see  that  when 
Bt  is  more  uncertain,  the ’controller  is  more  cautious,  as  it  should  be 
since  the  control  ut  affects  the  state  xt  through  Bt>  If  there  is, 
on  the  other  hand,  a high  correlation  between  At  and  Bt , then  the 
control  is  more  active  since  it  can  better  regulate  the  system.  This  is 
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so  even  in  the  extreme  case  where  B = 0,  that  is,  when  the  system  is 

'most'  uncontrollable  on  the  average,  since  the  controller  can  use  the  i 

information  about  the  high  correlation  in  a useful  way.  When  the  matrix 

A is  uncertain,  then,  of  course,  the  controller  will  be  more  active, 

though  the  degree  to  which  it  will  be  so  will  depend  on  the  other  terms 

1 

in  the  expression,  since  Kt  appears  in  both  the  numerator  and  the 
denominator.  Similar  observations  can  be  made  for  the  various  covariances 
in  the  equation  for  'm^ ' . For  example,  if  Bt  and  c^  are  strongly 
correlated  then  the  magnitude  of  m^  is  greater,  as  it  can  more 
effectively  cancel  the  exogenous  driving  term  c^.. 

We  note  also  that  the  certainty-equivalent  control  law  is 
different  from  the  optimal  control  law.  It  can  be  obtained  from  the 
optimal  law  by  setting  all  covariances  to  zero.  Basically,  the  optimal 
control  takes  into  account  the  uncertainty  in  the  parameters. 

The  optimal  control  is  without  any  posterior  learning.  This, 
in  fact,  we  had  already  anticipated  when  we  defined  our  information 
pattern.  The  random  matrices  in  the  system  equation  are  white  and 
therefore  unidentifiable.  It  is  as  if  at  each  new  time  instant,  the 
system  restructures  itself  anew  according  to  some  unknown  (and  not 

necessarily  constant)  probability  distribution,  whose  first  and  second  , 

moments,  however,  are  known  to  us.  The  control  system  must  adapt 
itself  to  this  visceral  change  in  order  to  minimize  the  cost-to-go. 

The  whiteness  of  the  noise  does  not  permit  us  to  reduce  future 
uncertainty  by  present  control  action,  which  is  to  say  that  the  control 
does  not  perform  a dual  role.  Note  however  that  the  optimal  decision 
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certainly  uses  a priori  knowledge  of  future  randomness.  That  is,  we 
know  and  make  use  of  the  a priori  knowledge  of  the  various  future  means 
and  covariances.  The  problem  and  its  solution  are  changed  if  we  exclude 
knowledge  of  future  statistics  from  the  information  pattern. 

Physically,  of  course,  this  is  quite  unrealistic,  and  we  ought  to 

J 

mention  some  ways  in  which  this  choice  of  modelling  a stochastic  system 
can  be  useful.  In  reality  some  learning  is  always  possible  and  systems 
are  never  so  insistently  white.  If  we  assume  that  the  parameters  are 
unknown  but  constant,  we  know  that  leads  to  the  well-known  dual  problem, 
which  does  not  admit  of  an  exact  analytical  solution.  With  our  assumption 
of  whiteness  we  face  a problem  that  is  analytically  tractable  and  that 
leads  to  a control  that  can  be  easily  implemented.  Moreover,  economists 
have  argued  that  in  economic  systems,  it  may  be  desirable  to  treat 
unknown  parameters  as  purely  random  to  obtain  a consequent  caution  in  the 
control,  especially  when  Bt  is  not  known  accurately.  Athans  and  Varaiya 
[44]  have  argued  that  the  control  of  white  parameter  systems  represents 
a worst-case  situation  in  which  the  ratio  (for  scalar  systems) 

K (0  I E,  * 0.  £b  * 0.  Eha  * 0) 

K <°  I E,  = h ' £ba  ’ 0 

provides  a measure  of  the  deterioration  in  performance  due  to  the  unknown 
parameters,  which  can  provide  a guide  as  to  whether  sophisticated 
parameter  estimation  and  adaptive  control  algorithms  are  warranted. 
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2.5  The  "Uncertainty  Threshold  Principle"  : 

In  this  section  we  examine  the  asymptotic  behaviour  of  linear 
random  parameter  systems.  We  assume  here  that  all  means  and  covariances 
and  the  weighting  matrices  in  the  cost  functional  are  constant. 

Let  us  first  consider  the  simplest  situation  of  scalar  systems 
in  a regulator  problem  type  setting  without  additive  noise.  We  have  : 


Vl  = Vt  + Vt  xo  given  (2.5.1) 

t = 0,1,2,  ...  , N 

Here,  at  and  b are  white  with  given  means,  variances  and  covariance, 
all  of  which  are  constant.  Note  that  the  term  c is  absent. 

N-l 

J = y E { l [ Qx*  ♦ Ru*  ] * Qx*  } (2.5.2) 

k=o 

Note  that  we  have  no  non-zero  trajectories  to  track. 


The  solution  to  this  is  obtained  from  our  earlier  general  solution 
and  is  given  by  : 


u* 

— 

LtXt 

(2.5.3) 

L 

s 

Kt+1  (Eab 

+ ab) 

(2.5.4) 

Lt 

* * <£b  * 

_b!>  Kt.i 

Kt 

= 

Q * Kttl<IJ  . 

r j Kt*l  ''.b  * SS)! 

‘ « * (£b  * Kf! 

(2.5.5) 

kn 

a 

Q 

(2.5.6) 

* 

J 

a 

ix2  K 

2 o O 

(2.5.7) 
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This  set  of  equations  has  been  investigated  by  Ku  [1]  and  gives 
rise  to  what  is  called  the  Uncertainty  Threshold  Principle.  This  is 
basically  a result  regarding  the  stability  of  the  nonlinear  difference 
equation  for  K . Its  implications  are  discussed  fully  in  Ku  [1],  Here 
we  shall  merely  give  an  informal  expositional  argument  and  then  see  what 
can  be  said  for  the  general  multivariable  case. 

In  Eq.  2.5.5  assume  that  K is  "large".  Then  we  have  the 
approximate  relation  : 

Kt  ^ m • Kt+1 

where  'm',  the  threshold  parameter,  is  given  by  : 

(£  h + ab)2 

m = E + a2 — (2.5.8) 

3 L ♦ b2 

b 

If  m > 1,  then  obviously  blows  up  as  N -*■  ® , so  that  a steady-state 
solution  does  not  exist  in  this  case.  In  fact,  the  uncertainty  threshold 
principle  states  that  for  the  infinite  horizon  problem,  a necessary  and 
sufficient  condition  for  a solution  to  exist  is  m < 1. 

If  K blows  up  for  the  infinite  horizon  problem,  then  so  does  the 

★ 

cost  J which  means  the  optimal  control  problem  has  no  solution.  This 
makes  good  intuitive  sense  too,  because  if  there  is  too  much  uncertainty 
in  a system  then  there  is  little  one  can  do  to  control  its  evolution 
over  a long  period  of  time. 

We  would  expect  a similar  result  to  hold  for  multivariable  systems 
as  well.  However,  it  seems  that  a neat  mathematical  expression  for  the 
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threshold  is  not  possible  owing  to  the  complexity  of  the  equations 

involved.  A special  case  of  multivariable  systems  has  been  explored  by  1 

Ku  [1]  in  which  the  e^j?nva lues  of  the  A matrix  have  to  satisfy  a 
threshold.  The  general  case,  in  which  we  consider  the  multivariable 
tracking  problem  with  additive  noise  is,  as  one  would  imagine,  hopelessly 

) 

complicated.  Here  we  must  consider  the  stability  of  three  equations, 
for  K , p and  g^ , to  determine  whether  the  infinite-horizon  cost  remains 
finite  or  not. 

2.6  Conclusion  : 

In  this  chapter,  we  have  stated  and  solved  the  optimal  tracking 
problem  for  a linear-quadratic  system  with  purely  random  parameters.  We 
briefly  noted  the  salient  characteristics  of  the  'Uncertainty  Threshold 
Principle'  and  found  that  the  multivariable  case  presents  formidable 
analytical  problems  which  may  make  it  impossible  to  derive  a mathematical 
expression  for  the  threshold. 

Now  that  we  have  the  complete  solution,  we  can  explore,  in  the 
next  chapter,  the  derivation  of  the  sensitivity  equations  for  this 
problem  and  then  apply  them  to  a macroeconometric  model  of  the  U.S. 


economy. 
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CHAPTER  3 

SENSITIVITY  EQUATIONS 

3. 1 Introduction  : 

In  this  chapter,  our  main  objective  will  be  to  develop  equations 
to  analyse  the  sensitivity  of  linear  systems  with  random  parameters  to 
variations  in  parameter  uncertainties. 

The  concept  of  sensitivity  is  a very  general  one  and  'sensitivity 
analysis'  is  a fairly  well-developed  tool.  In  any  real  system,  there  is 
always  some  uncertainty  associated  with  the  exact  values  of  its  parameters, 
either  because  of  imperfect  information  or  because  of  approximations  made 
in  the  modelling  process  or  possibly  because  of  some  inherent  randomness 
in  the  behaviour  of  its  parameters.  This  obviously  affects  the  efficacy 
of  any  control  law,  whether  open  or  closed  loop,  as  well  as  the  accuracy 
of  any  simulation  of  the  system.  If  the  behaviour  of  a system  is 
dramatically  different  as  a result  of  variations  in  parameter  values, 
then  we  say  the  system  is  very  sensitive  to  such  variations.  This  gives 
us  some  useful  information  in  assessing  the  reliability  of  our  efforts. 

An  excellent  example  of  such  a situation  is  provided  by  the  now  infamous 
'Limits  to  Growth'  report  b>  che  Club  of  Rome  [48].  Sharply  different 
qualitative  results,  such  as  lack  of  evidence  on  which  to  base  a 
prediction  of  the  collapse  of  world  population,  can  be  obtained  by 
appropriate  combinations  of  small  changes.  This  illustrates  the  caution 
that  is  necessary  in  basing  policy  judgments  on  sensitive  models. 
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There  are  many  different  questions  one  can  ask  in  this  area  of 
sensitivity  analysis.  One  basic  question  is  how  perturbations  in  the 
parameters  affect  the  optimal  performance  of  the  system.  If  the  optimal 
cost  or  optimal  welfare  are  significantly  altered  as  a result  of  small 
variations  in  the  parameters,  then  obviously  our  analysis  and  policy 
recommendations  are  not  very  reliable.  This  kind  of  study  is  probably 
most  useful  in  dealing  with  large  economic  and  socio-economic  systems, 
in  which  little  is  known  about  the  actual  structure  of  the  system,  and 
in  which  there  is  almost  always  a great  deal  of  uncertainty  about 
parameter  values. 

For  systems  with  parameters  that  are  modelled  as  being  deterministic, 
the  standard  procedure  is  to  derive  sensitivity  equations  with  respect  to 
variations  in  the  parameter  values  themselves.  This  has  already  been 
done  and  is  readily  available  in  the  literature. 

For  systems  whose  parameters  are  modelled  as  random  processes, 
however,  it  makes  sense  to  look  instead  at  the  effects  of  variations  in 
the  parameter  uncertainties,  that  is,  the  variances  and  covariances  of 
these  parameters.  This  leads  to  a slightly  modified  set  of  equations, 
though  the  basic  approach  remains  the  same.  Sensitivities  may  either  be 
absolute,  or  relative  to  the  parameter  and  optimal  cost  values,  and  it  may 
be  useful,  in  general,  to  look  at  both  sets  of  numbers.  We  can  even 
rank  parameters  in  order  of  their  sensitivities  which  may  help  to 
identify  the  'pressure  points'  of  a system. 
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We  shall  first  derive  general  sensitivity  equations  from  the 
optimal  control  solution  developed  in  the  previous  chapter.  Next,  we 
briefly  describe  a small  econometric  model  of  the  U.S.  economy  and  do  a 
sensitivity  analysis  of  the  model.  We  end  with  a discussion  of  the 
results  and  possible  uses  for  a sensitivity  analysis  and  ranking  of 
parameters . 


3.2  Problem  Statement  : 

We  are  given  the  following  linear  multivariable  system  : 


t + 1 


At  Xt  + 


ut  + ct 


(3.2.1) 


N-l 


We  have  perfect  measurements  of  the  state.  The  elements  of  the  matrices 
A^ , and  the  vector  c^  are  all  random  variables.  Each  element  con- 
stitutes a white  stochastic  process  with  given  mean  and  variance.  That 

is,  we  are  given  the  covariance  matrices  £ , £ , £ , £ . , E , E.  , where 

ABC  BA  Bc  Ac 

each  covariance  matrix  is  defined  by  the  convention  described  in 
chapter  2,  and  we  are  given  the  mean  matrices  A and  B and  the  mean 
vector  c.  We  choose  to  minimize  the  standard  quadratic  cost  functional: 

N-l 

J = y E { l [ (xt  - x )'Q  (x  - xt)  * (ut  - u )'R(ut  - u )] 
t=o 

+ (XN  ‘ XN),Q(XN  ' V } (3.2.2) 

The  sequences  (xt>  , {ut>  are,  of  course,  given. 


This  is  so  far  only  a restatement  of  the  optimal  control  problem 
considered  in  the  previous  chapter.  Its  solution  has  also  been  given  there. 
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Now  we  would  like  to  pose  the  following  question.  Let  o denote 
any  element  of  any  one  of  the  six  covariance  matrices.  The  question  is  : 
how  sensitive  is  the  optimal  cost  to  small  variations  in  a ? 

* 

• If  J denotes  the  optimal  cost,  then  the  answer  is  given  by  the 
9J* 

number  . Here  the  symbol  is  used  to  mean  'evaluated  at  the 

°°  o o 

given  values  of  the  various  means  and  covariances'.  This  number  is  an 

absolute  measure  of  sensitivity.  If  there  is  a small  absolute  change  6o 

* * 

in  a,  it  induces  a corresponding  absolute  change  6J  in  J , whose 
magnitude  is  given  by  the  relation  : 


We  can  also  obtain  a relative  measure  of  sensitivity  by  noting 

that  : 


(3.2.4) 


This  number,  -^1  — , tells  us  how  a percentage  or  relative  change 

3o  I o j* 

in  a is  transformed  into  a percentage  or  relative  change  in  J . In 


general,  the  appropriate  measure  will  depend  upon  the  application  at 
hand,  and  in  some  cases  both  measures  may  provide  useful  information. 
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For  now,  let  us  turn  to  deriving  equations  that  will  enable  us 

3J* 

to  evaluate  the  quantity 

3 . 3 Derivation  of  Sensitivity  Equations  ; 

The  derivation  of  sensitivity  equations  for  a linear  random 
parameter  system  is  quite  straightforward  though  the  final  equations  are 
somewhat  cumbersome  to  use.  We  first  restate  the  solution  to  the  optimal 
control  problem  (see  Chapter  2) . 


u* 

= 

Lt  xt  + mt 

(3.3.1) 

_ 1 

Lt 

= 

- [ R ♦ B'Kt+1B  ] [ 

B'Kt,iA  ] 

(3.3.2) 

■» 

rat 

- [ R + B'Kt+1B  ] [ 

. B'p,.,  - BBtJ 

■ 

(3.3.3) 

Kt 

Q ♦ [ J * [ B' 

VlA  1 Lt 

(3.3.4) 

Pt 

- 

- Qxt  * [A'Kt+1c]  ♦ A’ 

A.l  * \ 

(3.3.5) 

*t 

= 

i Q 5t  * i R Gt 

* 7 [e'Kt.ic!  * c'Vi 

* 7 tB'W  * “Vi 

- Rut)'  »t  • gt4l 

(3.3.6) 

s 

= 

Q 

(3.3.7) 

Pn 

= 

- <*N 

(3.3.8) 

= 

T *N  Q XN 

(3.3.9) 

* 

J 

= 

1 

— x'K  x + p x + g 

2 o o o *o  o °o 

(3.3.10) 
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The  evolution  of  the  state  is  now  given  by  : 


t + 1 


(A^  + BtLt)  xt  + B.m.  + c. 


t t 


x = x 
o o 


3J* 

In  order  to  calculate  -r — , we  need  to  calculate 

31  3m  L t us 

which  in  turn  require  us  to  calculate  x— °‘  e us’ 

90  90 


differentiate  the  appropriate  equations. 


(3.3.11) 

^ % 

9o  ’ 9o  * 9o  ’ 
therefore. 


Preliminaries  : 

Before  we  actually  carry  out  the  differentiation  let  us  state  a 
few  simple  algebraic  results  in  order  to  make  the  derivation  a little 
clearer. 


(b)  5;  - tr  fi  (3.3.12) 

(b)  Let  G be  a random  matrix  with  mean  G and  covariance  and  let  H 

G 

be  a deterministic  matrix  and  some  function  of  0,  where  0 may  be 
an  element  of  E„.  Then, 

U 


35  tG’HG  1 ^ I l tr  &Pl  W 


9o  -*k  W EU  + G’HG  1 

•l  l tr  (HPv  W Ev*  + A CG’HG) 


k,l 


k G V ‘'M  9o 


■ J tr  < ipk  W Eu  ♦ 5'  i5 


k,£ 


9Er 

* ‘HPk  Ek«. 


Let  f (G’HG)  41  tr  ( |ji  p.  1^)  Ek£  * t' 


k,£ 


9o 


(3.3.13) 


We  make  this  definition  only  to  save  us  some  repetitious  writing. 
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(c)  Let  r 


1 + quotient  [ 
1 + quotient  [ 
1 + remainder  [ 
1 + remainder  [ 


i 

- 

1 

n 

3 

- 

1 

n 

i 

- 

1 

n 

- 

1 

where  i = 1,2, 


2.  . _ , _ 2 
, n , 3 i,z,  •••  , n 


Let  a. ■ be  the  (i,j)-th  element  of 

13  u 


Then, 


3a. . 

13 


E.  • + E.  . - E. .6.  . 
U 3i  13  13 


(because  E^  is  symmetric) 


Therefore, 

3E„ 

pi  G p = 

k 3o. . £ 

13 


P'  E.  . P0  + P'E. . P.  - P,'  E.  .6. ,P„ 
k 13  ^ k 31  £ k 13  13  £ 


E 6,  6.  + E 6,  6.  - E 6,  6.  6.  . 

uv  kr  £s  vu  ks  £r  uv  kr  £s  13 


which  follows  from  the  fact  that  (i,j)  must  belong  to  the  (k,£)-th 
block  of  E^j  for  a non-zero  product.  Hence 


3Er 

l <HPk  5;. . h > Ek 

k ,£  13 


tr  (HE  ) E + tr  (HE  ) E - tr  (HE  ) E 6 . . 
uv  rs  vu  sr  mr  rs  lj 


h^  „ ♦ hUVE  - hVUE  6.. 
rs  sr  rs  13 


For  i = j,  this  simplifies  to 
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where  h is  the  (v,u)-th 
element  of  H,  etc. 
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Derivation  : 


We  shall  now  differentiate  the  optimal  equations  stated  above. 
There  are  six  separate  cases  to  be  considered  : a^.  can  be  the  (i,j)-th 

element  of  any  one  of  Z^,  Ig,  Z^,  £g^,  Zgc>  Z . We  sh.ll  only  look  at 
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Therefore, 


St‘1.f([B'Kt+1B).St_1.(B'Kt+1A)  - St_1 [f (B* K^A) 
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t + 1 rsJ 


(R*B'Kt  + 1B)-  ( l tr(Pt+1P-ZBP£)Ek)l  + B'P^B). 


(R  + B'Kt+1B)‘i.(B'Kt+1A) 


(R+B 'Kt+1  B) " * [ l tv(?t+^Vz)Ek,  + B’P  A 


+ k.  , E ] 
t+1  rsJ 


(3.3.19) 


3—,  (A'Kt  + lA>  + 3o~T  fB'Kt  + lA^Lt  + (B'Kt+lA)  35*. 
11  11  1J 


— V t-l  » 

f(A'K  .A)  + I tr  (K.  , P'  — - pin 
t+l  to  t+l  k - V LU 


[f(B'Kt+1A)  + l tr(Kt  + 1P-  _-BA  9)  E ] . Lt 

k,&  3o. . 

ij 


+ (B'Kt+iA)’  • iT 


(3.3.20) 


o. . e E. 
il  A 


0 


0 


48 


Therefore , 
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Evaluating  this  number  finally  gives  us  an  absolute  measure  of  the 
sensitivity  of  the  optimal  cost  to  variations  in  parameter  uncertainties. 
As  we  mentioned  before,  we  can  also  calculate  from  this  a dimensionless 
number,  a relative  sensitivity,  for  each  parameter,  viz. 

o.~ 

3J  ij 

3a..  ‘ J* 

13 


We  have,  at  this  point,  completed  our  derivation  of  the  cost 

sensitivity  equations.  It  is  also  frequently  useful  to  look  at  the 

sensitivity  of  the  optimal  control  law  to  parameter  variations.  Though 

the  transformation  itself  in  the  optimal  law  is  deterministic,  the  control 

is  random  because  the  state  is  random.  Here  again,  therefore,  it  is  more 

meaningful  to  calculate  the  sensitivity  of  the  covariance  matrix  of  the 

optimal  control  to  parameter  uncertainties.  Mathematically,  we  would 
3Eut 

like  to  calculate  — T-  where  Eu_  is  the  covariance  matrix  of  the 
3a  t 

le 

optimal  control  u^.  . We  have  : 


LtXt 


Therefore , 


Eu  = Lt^tLt  where  Et  = cov  {xt>  (3.3.40) 

We  need,  therefore,  to  calculate  Et.  This  turns  out  to  be  a gargantuan 
mess,  so  we  shall  not  bother  to  reproduce  it  here,  and  merely  indicate 
the  source  of  the  complexity. 
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Vi  = <At  + W xt  + Bt"t  + ct  (3-3-41) 

The  point  is  that  A t>  and  are  themselves  random,  so  that 
calculation  of  variances  becomes  doubly  complicated.  Some  relief  is 
afforded  by  the  fact  that,  at  each  time  instant,  x is  independent  of 
Af,  B^  and  c^,  but  even  so,  the  complexity  is  too  great  to  warrant  a 
derivation  here. 

3.4  Computer  Code  : 

In  Appendix  B,  we  code  the  solution  to  our  stochastic  control 
problem  and  the  sensitivity  equations  we  have  derived  in  this  chapter. 

More  precisely,  we  code  Equations  (3.3.1)  - (3.3.11)  and  (3.3.16)  - 
(3.3.39).  Though  all  the  quantities  represented  in  these  equations  are 
not  printed  out,  they  are  all  used  in  various  intermediate  calculations, 
and  so  can  easily  be  made  available  by  minor  alterations  in  the  program 
if  the  user  needs  them.  The  program  does  not  contain  sensitivity 
equations  for  a e £ , E , £.  . Since  this  program  was  used  for  a 
specific  application  it  also  has  a particular  specification  for  the 
target  sequence  { x } which  can  again  be  altered  by  the  user.  No 
sequence  { u^  } was  needed  for  this  application  because  we  used  R = 0. 

The  user  must  provide  both  target  sequences,  the  values  for  the  Q and  R 
matrices,  the  values  of  the  means  and  covariances  of  A,  B and  c,  and  the 


time  horizon  N. 
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j 

3.5  Conclusion  : . 

Now  that  we  have  derived  the  relevant  equations  let  us  see  how 
we  can  use  them  i.i  analysing  a specific  model.  For  this  we  choose  a 
small  econometric  model  of  the  U.S.  economy  and  analyse  it  in  the  next 

chapter.  . 


L 

\ 
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CHAPTER  4 

SENSITIVITY  ANALYSIS 

4 . 1 Introduction  : 

In  this  chapter,  we  shall  use  the  equations  we  derived  in  the 

j 

previous  chapter  to  analyse  the  sensitivity  of  a small  macroeconomic 
model  of  the  U.S.  economy.  We  first  describe  the  model,  then  recast  the 
equations  into  the  appropriate  optimal  control  framework,  and  finally 
present  some  simulation  results  with  a discussion  of  their  interpretation. 

Let  us  begin  in  the  next  section  with  the  model. 

4.2  A Simple  Macroeconomic  Model  : 

We  shall  describe,  in  this  section,  an  especially  simple  macro- 
economic  model  of  the  U.S.  economy.  This  model  was  developed  and 
estimated  by  Andrew  Abel  [47]  to  analyse  the  relative  effectiveness  of 
monetary  and  fiscal  policies  in  an  optimal  control  framework. 

It  is  based  on  real  quarterly  data  covering  the  period  from  1954/1 
to  1963/ IV,  which  corresponds  roughly  to  the  period  between  the  end  of 
the  Korean  War  and  the  beginning  of  heavy  U.S.  involvement  in  Vietnam. 

It  is  an  extremely  small  model,  consisting  of  only  two  endogenous  target 
variables,  consumption  and  investment  1^,  and  two  instruments, 
government  expenditures  E^  and  the  money  supply  . We  assume  that,  in 
the  short  run,  government  authorities  can  control  Et  and  M^  in  real  terms 
since  prices  do  not  change  rapidly  enough  to  seriously  neutralize  their 
actions.  Over  the  time  period  covered  by  our  data,  the  rate  of  inflation 
was  low  enough  to  make  this  assumption  plausible. 
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This  model  is  based  on  a closed  economy.  Desired  consumption  is  a 
linear  function  of  GNP,  and  the  realized  period-to-period  adjustment  in  i 

consumption  is  subject  to  a partial  adjustment  factor  : 

Ct  = aCt_1  ♦ blt  + bE  + d (4.2.1) 

t 

The  structural  equation  for  investment  is  based  upon  a modification  of 

Samuelson's  private  consumption  accelerator.  We  posit  that  the  desired 

level  of  the  capital  stock  is  a linear  function  of  consumption  and  that  1 

j 

the  realized  adjustment  of  the  capital  stock  is  subject  to  a partial  I 

adjustment  factor.  Since  gross  investment,  I , is  defined  as 

- (1  - D)  K where  D is  the  depreciation  rate  of  the  capital 
stock,  we  have 

It  = eCt  - (1  - DJeC^j  * f 1^  ♦ 8 

In  addition,  we  assume  that  the  level  of  gross  investment  is  linearly 
related  to  the  money  supply  in  order  to  capture  some  of  the  effects  of 
interest  rates  upon  investment  : 

It  = e'Ct  - (1  - D)e'C  j + f ' I + hMt  + g'  (4.2.2) 

The  estimated  reduced  form  equations  corresponding  to  the  structural 
equations  are  : 

C = 0.926*  C - 0.0203  I + 0.3190  E - 0.4206  M 

(0.0534)  (0.0916)  (0.1389)  (0.1863) 

- 63.2386 
(25.7718) 

R2  = 0.9958 


D - W 


1.7084 


(4.2.3) 
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I = 0.1527  C + 0.3806  I - 0.0735  E + 1.5389  M 

(0.0781)  (0.1339)  1 (0.2031)  t (0.2724)  l 

- 210.8994 
(37.6899) 

R2  = 0.8749 

D-W  = 1.7582  (4.2.4) 

2 

Note  that  each  of  these  estimated  equations  has  a high  value  of  R . 

In  addition,  the  Durbin-Watson  statistic,  although  biased  towards  2.0 
because  of  the  lagged  endogenous  variable,  does  not  suggest  significant 
serial  correlation  in  either  equation.  The  figures  in  parentheses  are  the 
corresponding  standard  errors. 

4 . 3 Conversion  into  Optimal  Control  Framework  : 

Let  us  recast  the  reduced  form  equations  in  the  previous  section 
into  state  variable  form.  We  shall  write  the  model  as  a first-order 
linear  vector  difference  equation  with  random  coefficients  : 


(4.3.1) 
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This  is  a small  difference  in  the  approach  of  control  theorists  and 

econometricians  and  is  merely  a matter  of  definition.  Both  refer  to  i 

the  policy  variable  that  must  be  used  to  directly  influence  the  state 
at  time  (t+1). 

The  coefficients  of  the  various  variables  in  the  reduced  form  j 

equations  give  us  the  respective  means  of  the  random  matrices  A{  , Bt  and 
the  random  vector  ct.  We  have  : 


ra 

a 

- 

1 

11 

12 

0.9266 

-0.0203 

A,  = A 

= 

t 

a21 

*22J 

0. 1527 

0.3806 

_b 

b 

r- 

- 

11 

12 

0.3190 

0.4206 

B = B 

= 

t 

b21 

b22 

-0.0735 

1.5389 

— 

J 

— 

— 1 

V 

-63.2386 

c = c = 

s 

t 

c2 

-210.8994 

J 

— — 

The  covariance  matrices  are  defined  by  the  convention  in  Chapter  2. 
These  are  obtained  from  the  standard  errors  of  the  various  random 
variables.  The  square  of  each  standard  error,  that  is  the  number  in 
parentheses  under  each  coefficient  in  Eqs.  (4.2.3)  - (4.2.4)  gives  the 
variance  of  the  corresponding  variable.  Thus  the  diagonal  entries  of 
ZA  are  the  variances  of  a^,  a^^,  a^  and  in  that  order.  The  off- 
diagonal  entries,  the  covariances,  we  somewhat  arbitrarily  set  to  zero. 
(Ignoring  the  covariances  will  usually  tend  to  overestimate  the  size  of 
the  model's  forecast  errors.  The  majority  of  the  estimated  covariances 
are  usually  negative  and  cancel  part  of  the  variance  in  each  coefficient. 
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Ignoring  the  covariances  thus  tends  to  overemphasize  the  degree  of 
fluctuation  in  the  coefficients.)  All  the  covariance  matrices  are 
constant . 


ZA  = diag  [ var(au),  var(a21),  var(a12),  var(a22)  ] 

.0029  000 

0 .0070  0 0 

! 0 0 .0084  0 

1^0  0 0 .0179 

Eg  = diag  [ var(bn),  var(b?1),  var(b12),  var(b22)  ] 


.0193  0 0 

0 .0412  0 

0 0 .0347 

0 0 0 


0 

0 

0 

.0742 


E 

c 


diag  [ varfcp,  var(c2)  ] 


r 664. 1908 


( 

L 


0 


0 

1420.5286 


We  also  need  to  define  the  values  of  the  cross-covariance  matrices 
EgA>  ^bc’^Ac"  ^*e  est^mat^on  procedure  used  in  Abel's  paper  does  not 
provide  us  with  estimates  of  these  covariances,  so  here  again  we  shall 
arbitrarily  set  them  all  equal  to  zero.  This  will  also  help  a little  in 
reducing  the  complexity  of  the  various  equations  we  have  derived.  We 
have,  therefore  : 
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Z 

Z 

z 


BA 

Ac 

Be 


0 

0 

0 


At  this  point,  we  have  completely  specified  the  linear,  random 
coefficient  structure  of  the  economic  system  in  state  variable  form.  To 
analyse  the  system  in  an  optimal  control  framework,  we  need  to  specify  a 
cost  criterion 


J 


h { r tex 

t=0 


\)'  Q(xt 


xt)  + (ut  - ut)  R(ut  - ut)] 


(Xv 


- XN) 


Q (x. 


We  need  to  choose  suitable  values  for  the  targets  {xt>,  {u  } t = 0,1,..., N 
and  specify  the  weighting  matrices  Q,  R and  the  time  horizon  N.  Following 
Abel,  we  examine  the  historical  growth  rates  for  consumption  and 
investment  over  the  period  of  estimation,  1954/1  to  1963/IV,  which  turn 
out  to  be  0.91  % and  1.14  % per  quarter  respectively.  With  these  in  mind, 
we  select  target  growth  rates  of  1.25  % per  quarter  for  both  C and  1^ . 
Mathematical ly , 

xt  = (1.012S)t  xQ  t = 0,1,2,  ...  , N 

We  shall  restrict  our  choices  for  Q to  diagonal  matrices  for  the 


purpose  of  the  analysis.  We  shall  use  the  following  five  values  for  the 
Q matrix  to  compare  different  solutions. 
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Q 

Q 

Q 

Q 

Q 


10 


L 0 

“ 2 
0 


L° 


i 

0 


diag  (10,1) 

diag  (2,1) 

diag  (1,1) 


diag  (1,2) 

diag  (1,10) 


A 


A 


A 


A 


A 


(10.1)  for  simplicity 

(2.1) 

(1,1) 

(1,2) 

(1,10) 


Henceforth  the  notation  (10,1),  (2,1)  etc,  will  be  used  to  denote  the 
diagonal  entries  of  diagonal  Q matrices.  We  shall  use  this  simplified 
notation  especially  when  we  present  the  simulation  results. 


We  choose  the  R matrix  to  be  zero  throughout  to  simplify  the  analysis. 


R = 0 


Since  R is  chosen  to  be  zero,  we  do  not  need  to  specify  the  targets 
{u^.}  . The  cost  criterion  is  reduced  to  : 


J 


7 E { l (xt  - x )'  Q (x  - x ) } 
1 t-o  r 


After  doing  a few  simulations,  it  was  decided  that  N = 15  would  be  large 
enough  for  the  analysis  without  incurring  too  great  a cost  for  the 
simulations. 


1 


* 
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The  last  item  that  needs  to  be  specified  is  the  initial  conditions. 
From  the  historical  record  we  find  that 


i <o 


S9 


The  units  used  are  billions  of  dollars.  and  M , the  instruments, 

also  have  the  same  units.  Note  that  x = x by  definition. 

o o ' 


This  completes  the  statement  of  the  problem.  In  the  next  section, 
we  present  some  simulation  results. 


4.4  Interpretation  and  Discussion  of  Results  : 

We  shall  now  present,  in  the  form  of  graphs  and  tables,  some 
simulation  results  describing  the  behaviour  of  our  econometric  model  in 
an  optimal  control  framework.  In  this  section  we  shall  analyse  some  of 
these  results  and  leave  others  for  future  research. 

First,  some  general  observations.  As  with  other  tracking  problems, 
this  problem  can  be  split  into  one  part  that  helps  to  regulate  the  state 
and  another  that  helps  it  to  track  the  desired  trajectory  and  cancel  any 
additive  driving  terms.  We  see  that,  in  the  event  that  all  the  covariance 
matrices  are  zero,  the  optimal  control  tracks  perfectly.  This  is  seen 
from  the  uppermost  curves  in  Figs.  1 and  2.  This  is  to  be  expected  since 
R = 0 and  there  is  no  constraint  on  the  control  energy  expended  in  the 
process.  Also,  in  our  problem,  x = xQ,  so  there  is  no  initial  error. 

This  deterministic  solution  is  also  the  certainty-equivalence  solution 
[ ] , and  we  observe  that  the  certainty-equivalence  principle  does  not  hold. 


* 


■ 


6" 


In  the  stochastic  case,  with  Z.,  ZD  and  I nonzero,  we  must  first 
understand  what  it  means  for  the  state  to  track  the  desired  trajectory. 
Since  A,B  and  c are  all  random  so  are  x and  (though  the  gain  and 
the  correction  cum  tracking  term  m are  deterministic).  The  control 
attempts  to  minimize  the  mean  square  error  of  the  state  trajectory  which 
means  it  tries  to  keep  the  mean  of  the  error  plus  the  variance  of  the 
error  small.  In  other  words,  there  is  a trade-off  between  keeping  the 
average  state  close  to  the  desired  trajectory  and  keeping  the  variance 
of  the  error  low.  In  general,  therefore,  we  shall  find  that  the  average 
state  evolution  does  not  track  perfectly.  This  is  so  even  though  R = 0. 
In  Figs.  1 and  2,  we  have  plotted  the  means  of  the  state  trajectories  for 
the  different  values  of  Q.  Ke  see  here  that  these  mean  trajectories 
fall  short  of  the  perfect  certainty-equivalent  trajectory.  Of  course, 
the  actual  trajectory  we  would  get  from  any  stochastic  simulation  would 
be  different  each  time  since  we  would  have  different  realizations  of  A 
B and  c^  - this  is  true  for  both  the  state  and  control  variables. 


The  certainty-equivalent  solution  for  R = 0 simplifies  to  : 


- B_1A 


- B~ 1 (c  ♦ Q'1  pt+1) 


- 1-1  - Vl} 


Q 


2 *t  Q Xt 


(4.4.1) 

(4.4.2) 

(4.4.3) 

(4.4.4) 

(4.4.5) 


J 


0 


(4.4.6) 


time  (in  quarters) 

Consumption  vs.  time,  iiq  . ('..5.11),  for  N = 15.  lor  the  C.L. 
case,  all  covariance  matrices  are  set  equal  to  zero.  The  C.L 
curve  is  identical  with  the  desired  trajectory. 


time  (in  quarters) 

Investment  vs.  time,  Fq.  (5.3.11),  for  N = IS.  For  the  C I 
case,  all  covariance  matrices  are  set  equal  to  ;ero.  The  C 
curve  is  identical  with  the  desired  trajeetorv. 
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Substituting  these  equations  into  the  mean  of  the  state  equation  we 
get. 


t + 1 


Axt  + BL^x^.  + Bm^  + c 


(A  - B.B  \a)  x - B.B'1?  + B.B'1  x + c 
t t+1 


x , as  expected. 


(4.4.7) 


Note  that  the  gain  , the  additive  term  in^  and  the  average  state  x 
and  the  average  control  law  u are  all  independent  of  the  choice  of  Q. 
This  is  why  we  need  not  specify  the  value  of  Q for  the  certainty-equivalence 
curves  in  Figs.  1 and  2.  The  different  curves  for  the  stochastic  case 
are  identified  by  the  corresponding  values  of  Q. 


The  gain  L in  Eq.  4.4.1  serves  to  cancel  the  coefficient  matrix  A 

which  it  does  exactly  in  the  mean  case  when  A = A,  whereas  the  term 

cancels  the  additive  exogenous  term  c as  well  as  forces  the  state  to 

track  the  target,  both  of  which  again  are  done  exactly  in  the  mean  case. 

★ 

Note  that  the  optimal  cost  J is  zero  (Eq.  4.4.6),  the  absolute  minimum 

★ 

of  J, because  R = 0 and  because  the  state  tracks  perfectly,  J is  also 
independent  of  Q. 


Let  us  now  examine  the  stochastic  case  more  closely.  Our  first 
observation  of  the  simulation  results  is  that  the  regulator  part  of  the 
problem  viz.  L and  K , is  well  behaved.  We  have  plotted  in  Fig.  3 the 
certainty-equivalent  and  the  stochastic  K for  Q = (1,1).  There  are 
four  graphs,  one  for  each  element  of  Kt . Since  K is  symmetric  two  of  the 
graphs  representing  the  off-diagonal  terms  are  identical.  We  plot,  in  a 
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similar  way,  L in  Fig.  4,  again  for  Q = (1,1).  The  certainty- 

equivalent  value  of  in  this  figure  is  given  by  F.q.  (4.4.1).  Both 

quantities  soon  reach  a steady  state,  seen  backward  in  time.  The 

correction  terms  in  Fig.  5 keeps  growing  because  it  has  to  track  xt 

in  addition  to  cancelling  the  exogenous  term  c^.  The  optimal 

cost  also  keeps  growing.  However,  since  K is  steady  initially,  we 

can  deduce  that  the  regulator  component  of  the  cost,  — x'K  x , settles 

2 o o o 

to  a steady  state.  The  tracking  error  naturally  keeps  accumulating 
and  this  makes  the  cost  grow.  The  behaviour  of  FL  (Fig.  3)  leads  us  to 
the  conclusion  that  the  uncertainties  in  the  problem  are  within  the 
uncertainty  threshold  (even  though  we  do  not  know  exactly  what  the 
threshold  is).  We  shall  find  later  that  even  if  Z,  is  multiplied  bv  a 
scale  factor  of  30,  K does  not  blow  up.  This  seems  reasonable  when 
one  inspects  the  numerical  values  of  A,  E^,  B,  Zg  which  are  all  fairly 
small.  The  elements  of  Z^,  Z^  in  particular  are  all  « 1. 


Q • [ A'KttlA  ♦ I ^ trlhtl  Z-x  ^ ] 


Note  that  Z^A  = 0 in  our  problem.  Since  Q £ 0,  Z^  £ 0,  Eg  0,  the 
structure  of  the  equation  tells  us  to  expect  > Q or  equivalently, 
l|  Kt  1 1 5-  1 1 Q ||  where  ||  M ||  = (det  M)*'“.  This  is  in  fact  borne  out 

by  the  simulation  results.  In  Table  1,  we  present  some  norms  of  Kt  for 
different  Q.  This  demonstrates  that  the  steady  state  "value"  of  in 
the  stochastic  case  is  greater  than  that  in  the  certainty-equivalent  case. 
This  confirms  our  intuition  that  we  need  more  "force"  when  there  is 
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Q 

II  Q II 

II  K0  || 

r 

j|  (10,1) 

3,16 

1 

3 . 64 

....  n 

(2,1) 

1.41 

1.62 

1 

(1,1) 

1.00 



1.18  I1 

[ 

| (1,2) 

1.41 



1.75 

f 

1 (1,10) 

3.10  " 

4.74 

Table 


Comparison  of  norms  of  Q and 
corresponding  K . 
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.uncertainty.  The  end  point  constraint  = Q forces  K to  come  down  to 
the  C.E.  value  at  X (Fig.  5).  Physically,  represents  a sort  of 
cumulative  weighting  matrix  which  incorporates  both  the  present  error 
at  time  t as  well  as  the  propagation  of  this  error  as  t progresses 
to  N.  When  t <<  X we  would  expect  the  slope  of  to  be  relatively 
horizontal  since  the  future  error  weighs  about  the  same  for  small  t 
far  from  N.  However,  as  t gets  close  to  X,  is  determined  more  by 
the  present  error  since  the  propagation  error  gets  smaller,  so  that  it 
begins  to  fall  to  Q,  till  at  t = X,  there  is  no  future  and  K exactly 
equals  the  present  error  weighting  matrix  Q.  We  have  ignored  here  the 
effects  of  non-zero  R.  The  steady-state  value  is  greater  in  the 
uncertain  case  because  we  are  minimizing  the  mean  square  error,  as 
opposed  to  just  the  mean  error  so  that  there  is  greater  propagation  of 
the  present  error  and  K > Q.  This  description  can  quite  easily  be 
extended  to  the  case  of  time-varying  Q's.  Note  also  that  if  E f 0, 
then  the  propagation  of  the  uncertainty  in  the  error  is  somewhat  reduced, 
since  B and  A are  now  correlated  and  the  control  can  make  use  of  this 
additional  information.  However,  because  of  the  restrictions  placed  by 
the  various  correlation  coefficients,  the  effects  of  uncertainty  cannot 
be  completely  nullified.  This  is  also  supported  by  the  mathematics. 

The  gain  r.  , Fig.  4,  follows  the  behaviour  of  in  a mathematical 
sense.  It  is  steady  initially  and,  as  t approaches  X,  it  moves  away  from 
the  steady-state  value  just  as  Kt  does.  Again,  it  basically  attempts  to 
minimize  the  mean  square  error  instead  of  just  the  mean  error.  Note  that 
L represents  only  the  regulator  part  of  the  control  and  is  totally 
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independent  of  the  targets  and  the  driving  term  c.  The  scalar  case 
provides  some  insight  into  its  behaviour. 


b + of 


f ( — 

1 ♦ ab2/b2 


Note  that  in  the  scalar  case  H is  constant  even  in  the  stochastic  case. 
Also,  note  that  decreases  in  absolute  value  as  increases,  other 
things  remaining  the  same. 


(a  + bZ  ) xt  + bmt  + c 


u 2 . _ ■ X + b m + c 

d + a,  2 t t 


Ihe  coefficient  of  x has  the  foPowing  approximate  behaviour  : 


when  = b,  the  coefficient  vanishes,  thereby  keeping  + ^ close  to  zero, 
as  required  by  the  regulator.  The  optimal  gain  is  chosen  so  as  to  minimize 


E(a  + b;.t)2 


dT  F(a  + bV  = 0 


Therefore  2 ab  ♦ fb2  + a,  2)i  = 0 

b t 


Therefore  P 


— as  required 


2 
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! ,'i  i ' short  derivation  merely  shows,  from  a different  perspective,  that 
■-j.  does  the  stochastically  optimal  thing.  The  vector  case  behaves 
essentially  in  the  same  way  though  the  mathematics  is  a trifle  opaque 
because  the  appropriate  quantity  to  minimize  for  the  one-step  optimal 
gain  is  E[(A  + EL^)’  K^  + ^(A  + BI.^)],  because  + ^ embodies  the  correct 
cumulative  weighting  at  time  t. 


The  term  p{  is  again  essentially  a mathematical  entity  like  K . 
The  equation  for  i s : 

Pt  = - Qxt  - A-Kt  + 1c  ♦ A'pt  + 1 ♦ (VK~Bj.mt 


- (A‘Kt+1B).(B'Kt+1  _1(B»Kt+1  • B«Pj>1) 

PN  = - Q *N 


Its  behaviour  can  be  understood  in  analogy  with  that  of  K . It 
has  two  basic  functions.  The  first  is  its  role  in  providing  a correction 
term  to  cancel  the  exogenous  term  c and  the  second  to  provide  a 
cumulative  weighted  measure  of  the  desired  trajectory.  To  understand 
these  roles  more  clearly  let  us  look  at  them  separately.  First  let  us 
assume  that  the  desired  trajectory  is  zero  i.e.  x = 0 for  all  t. 

Then , 


"W 


t + 1 


(A*Kt+1B)CB'Kt+iB)-l(B'Kt+iS 


Vl> 
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We  note  here  that  the  behaviour  of  p is  directed  towards  c.  At  t=N, 
p = 0 because  cannot  affect  the  optimal  cost.  Now  let  us  assume 
that  c=0,  we  get, 

Pt  • - <St  * *'Pt.i  - 

‘ ' Q 

This  shows  how  at  t=N,  p represents  a weighted  target  and  for  earlier  t, 

IN 

how  it  incorporates  both  the  present  target  in  the  term  - Qx  and  the 
propagation  of  this  in  the  future  as  well  as  future  targets  in  the  rest 
of  the  equation.  In  the  general  case  when  R f 0,  p also  includes  the 
weighted  control  targets  in  the  term  - Ru  . 

Just  as  K , gives  us  the  gain  L so  pt  , (in  combination  with 
t+1  * t rt+l 

K , 1 gives  us  the  additive  term  m . which  embodies  the  two  roles  of  pt 
t+1  t’  rt 

explicitly  in  the  control.  The  first  role  is  to  act  as  a correction  term 
to  offset  the  exogenous  vector  c.  This  function  is  independent  of  the 
regulator  and  tracking  parts  of  the  problem  or,  in  other  words,  it  is 
needed  in  both.  The  second  function  is  tracking.  It  is  responsible  for 
making  the  state  track  the  desired  trajectory.  These  two  objectives  are 
clearly  observable  in  the  equation  for  m^ . 

"t  ■ - 1 “’N.r®  * i 

We  see  from  Fig.  5 that  the  behaviour  of  m shows  an  approximately  steady 
growth.  Though  the  corrective  component  does  reach  a steady  state  the 
tracking  component  does  not  since  the  target  itself  grows  with  time.  Its 


Y 


I 


so 


behaviour  could  also  be  understood  in  terms  of  the  minimization  of  a 

suitable  expression  as  we  did  for  L . However,  this  is  complicated  by 

the  fact  that  both  K , and  p , enter  into  it. 
t+1  rt+l 

Now  that  we  have  some  description  of  the  behaviour  of  the  various 
components  of  the  problem  we  can  better  appreciate  the  behaviour  of  the 
control  u^  and  the  state  x . 

The  certainty-equivalent  control  u is  given  by  : 

Ut  = Lt  xt  + mt  = - B_1A  xt  - B_1(c  - *t+1) 
and  the  certainty-equivalent  x is  : 


This  shows  that  and  x in  the  certainty-equivalent  case  must  be 

approximately  linear  (since  x = [1  + 0.0125J  x ).  This  is  borne  out 

t t o 

by  Figs.  1-2  and  Figs.  6-7.  In  the  stochastic  case  we  find  that  iu 

CE 

tries  to  approach  u^  in  the  "middle",  as  we  would  expect.  At  this 
point  it  is  useful  to  look  at  the  mean  values  of  the  A and  B matrices  : 
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Q = (1,1) 


(10,1) 

(2,1) 

(1,1) 


(1  2) 


(1,10) 


fimG  ( in  quarters) 

l:ig. 6,  Government  expenditure  vs.  time,  Fq.  (A. 4),  for  N - 15. 

For  the  C.E.  ease,  all  covariance  matrices  are  set  equal 
to  zero . 
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Looking  at  the  relative  values  of  the  elements  of  A,  we  see  that 
average  consumption  C is  essentially  independent  of  average  investment  I, 
though  I does  depend  on  C.  Also,  owing  to  the  relative  values  of  the 
elements  of  B we  see  that  the  average  government  expenditure  does  not 
really  affect  investment  I . However,  E^  influences  C^+1  directly 
which  in  turn  influences  I ?,  so  that  the  effect  of  average  government 
expenditure  on  average  investment  is  experienced  two  periods  later.  We 
note  also  that  both  the  instruments  can  influence  consumption. 

In  the  stochastic  case  we  see  that  as  the  relative  weighting  of 
consumption  and  investment  in  the  weighting  matrix  Q changes  in  favour  of 
one  or  the  other,  the  corresponding  state  approaches  the  target  more 
closely,  as  one  would  expect.  In  Fig.  1,  the  perfect  C.E.  case  is  at 
the  top.  Below  this  comes  the  curve  corresponding  to  Q = diag  (10,1). 

As  the  relative  weighting  of  consumption  decreases  to  Q = (2,1)  the  mean 
consumption  trajectory  drops  even  further  down.  This  trend  continues 
till  Q = (1,10).  In  Fig.  2,  we  observe  exactly  the  opposite.  Q = (1,10) 
represents  the  case  for  which  investment  tracks  most  closely  since  the 
relative  weight  of  I is  highest  here  and  it  gets  progressively  worse  as 
we  go  to  Q = (10,1). 

* 

Finally,  the  optimal  cost  J needs  to  be  considered.  W'e  find  that 
it  can  also  be  divided  into  two  parts  : the  regulator  part  and  the 
tracking  part.  The  regulator  part  comes  from  the  terra  \ XoKoXo’ 
the  same  as  the  cost  for  the  corresponding  regulator  problem.  The 
additional  terms  Pqx0  and  gQ  explain  the  tracking  part  of  the  cost. 
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The  term  ’g  ' represents  a residual  type  cost  (the  dynamic  counterpart 

of  the  constant  term  'c'  in  the  minimization  of  a quadratic  function 
7 * 

ax"  + bx  + cl.  We  note  also  that  J increases  as  I,  increases,  since  the 

A 

control  becomes  less  and  less  capable  of  controlling  the  system 
effectively,  (Fig.  S)  . 

Let  us  now  look  at  the  sensitivities  of  some  of  the  parameters.  To 

keep  things  simple  we  shall  only  look  at  the  sensitivities  of  the  diagonal 

elements  of  £ and  E . Note  that  a..  = var  (a,.),  a_-  = var  (a_,), 
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var  (a . . ) 
i J 

by  o (a.  . ) 
ij 

and  var  (b^j)  by  o(b^.).  The  relative  sensitivities  corresponding  to 
different  Q matrices  are  given  in  Table  2 and  are  then  ranked  in  Table  3. 
We  do  the  same  with  the  absolute  sensitivities  in  Tables  4 and  5. 

Our  first  observation  is  that  none  of  the  parameters  3re  overly 
sensitive.  We  note  that  the  highest  relative  sensitivity  is  only  .3  or 
30°,;.  We  can  call  a relative  sensitivity  of  1 or  100%  high  because  that 
implies  a variation  of  a magnitude  commensurate  with  the  actual  value. 
Judging  by  this  standard  sensitivities  of  .5  or  less  are  negligible. 

Thus,  in  a general  sense,  this  model  is  quite  insensitive  to  variations 
in  parameter  variances.  In  other  words,  at  least  for  this  model,  this 
method  of  analysing  sensitivity  does  not  yield  much  useful  information, 
besides  the  fact  that  the  model  is  insensitive  and  therefore  reasonably 


rel iable. 


86 


87 


' Q: (10, 1) 

L_ 1 

3: (2,1 

f Q: (1,1) 

1 I 

! Q:  d,2)  i 

i i 

| Q : ( 1 , 1 0)  ]1 

l Xi 

I D 

[ . . 

c(bi2)  j 

r _ i 
C(b22) 

a(b  ) 

i 

i j| 

a(b22) 

a(bn) 

°(b22) 

a(b2p  ; 

a(a2i) 

o(a2i) 

a(all) 

o (t>  1 1 ) 

o(a21> 

°(b2i ) 

0(b21}  ! 

o(ai,) 

a(b2i) 

0(b12) 

1 

o(a22) 

0(b22} 

o(au) 

o(bn) 

a(a22) 

°(b12) 

0(b21) 

o(a2i) 

! o(au) 

| •(.„) 

a(a2i) 

CT(a12} 

0(a22} 

! 0(bi^ 

°<bn>  : 

1 qla22>  ! 

o(a22) 

1 “ ! 

o(ai2) 

0(a12> 
i 

J 

o(ai2)  j 

Table  3.  Ranking  of  parameters  in  order  of  decreasing 
relative  sensitivity 
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Table  5.  Ranking  of  parameters  in  order  of  decreasing 
absolute  sensitivity 
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If  we  look  at  the  variations  in  the  sensitivity  ranks  as  Q is 
changed,  we  find  a reasonable  pattern.  When  consumption  is  more  heavily 
weighted  than  investment,  we  find  that  the  parameters  o(a^),  0(3^), 
o(b^),  o(b^)  tend  to  be  more  sensitive,  whereas  when  investment  is 
more  heavily  weighted  the  parameters  o(a0^),  a(a_,-,),  o(b?j),  o(b0?)  are 
more  sensitive  (Tables  3 and  5).  This  is  as  it  should  be  as  is  evinced 
by  the  positions  of  these  parameters  in  the  covariance  matrices  : 
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What  happens  in  the  sensitivity  equations  is  that  the  above  shown  2x2 
blocks  enter  into  the  mathematics  directly  through  the  terms  P^E^P^.  , 

P'Z  P„.  Since  c(a,.),  a (a  ),  o(b.,),  o(b,.)  occupy  the  top  left 
positions  in  these  blocks  they  contribute  to  the  error  in  the  propagation 
of  consumption  and  as  consumption  assumes  a greater  relative  importance 
in  the  cost  functional,  these  parameter  variances  become  more  sensitive. 
This  is  shown  by  the  column  of  rankings  under  Q = (10,1)  in  Table  3. 
Exactly  the  same  happens  in  the  other  direction  with  investment.  The 
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parameters  c(a_,j  ),  o(a,2).  a (b^^),  a(b?1)  occupy  the  bottom  right 
positions  in  these  blocks  and  thereby  contribute  ‘o  the  error  in 
investment,  so  that  they  become  more  sensitive  as  the  relative  weighting 
of  investment  increases.  As  we  move  from  the  column  under  Q = (10,1)  to 
the  column  under  Q = (1,10)  from  left  to  right  in  Tables  3 and  5,  we 
find  that  the  parameters  ofa.^),  o(a,,,),  a(b-,j),  o(b_,7)  move  from  the 
bottom  of  the  columns  gradually  to  the  top  when  we  get  to  Q = (1,10). 
This  pattern  also  makes  sense  physically  When  consumption  is  more 
important,  one  would  expect  the  higher  sensitivities  to  be  with  the 
first  rows  of  A and  B which  parameters  affect  consumption  directly. 

More  e xp 1 i c i 1 1 y 


't-1 


11 


11 


12 


The  other  parameters  a,^,  a^,  b b -)1  affect  C only  indirectly.  The 
same  is  true  for  investment. 


t + 1 


a„,  C + a„„  I 
21  t 22  t 


b21  Et  + b22 


From  this  one  would  expect  o(a?^),  o(a77),  0 (b 
sensitive  as  is  borne  out  by  the  results. 
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21 
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22 


to  be  more 


Q = (2,1)  seems  to  represent  some  sort  of  a "break-point1  that 
weights  consumption  and  investment  in  some  "equitable"  manner.  Firstly, 
we  find  that  the  relative  sensitivities  at  this  value  are  all  evenly 
distributed  i.e.  there  is  no  priority  in  ranking  in  either  group, 
[oCajj),  0(a12),  o(bn),  o(b12)]  or  [o(a21)t  o(a72),  0(b21),  a(b_,2)  J . 
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See  the  column  under  Q = (2,1)  in  Table  3.  If  we  increase  the  relative 

weight  of  consumption  towards  Q = (10,1),  then  we  find  elements  of  ! 

[o(a  j),  a( a^),  ath^),  cfb^)]  becoming  more  sensitive  whereas  if  we 
decrease  it  towards  Q = (1,1),  (1,2)  and  (1,10),  we  find  [o(a  ),  a(a^7) , 

C(b_,j),  c(b7,)]  becoming  more  sensitive.  Of  course,  since  our  data  comes 

1 

from  only  five  Q matrices,  we  cannot  have-  the  exact  break-point  but  we 

can  say  that  it  lies  roughly  near  Q = (2,1).  This  also  seems  to  be  the 

* 

Q that  gives  the  lowest  value  for  the  optimal  cost  J scaled  by  the  norm 
of  the  corresponding  Q,  as  can  be  seen  from  Table  6.  In  addition  to  this. 

Table  7 indicates  that  ||  L j|  is  largest  in  the  Q = (2,1)  case.  Of  course, 

★ 

the  certainty  equivalent  J equals  zero  and  is  lower  than  the  above 
scaled  J , and  |j  LQ||  ^ = .682  is  also  higher  than]!  Lq||  for  Q = (2,1). 

■it 

The  fact  that  J is  lowest  for  this  Q means  that  this  represents  the 

•k 

minimum  of  J taken  over  all  Q.  Similarly,  the  fact  that  ' ' L ]]  is  highest 
seems  to  imply  that  the  control  is  most  forceful  in  this  case.  All  this 
points  to  the  fact  that  Q = (2,1)  represents  a special  weighting  matrix. 

The  specific  value  of  Q depends  of  course  in  some  complicated  way  on  the 
values  of  A,  B and  Z^,  Z^.  However,  the  important  point  is  that  it  gets 
closest  to  the  certainty-equivalent  case  in  some  average  way.  It 
represents,  in  a certain  sense,  an  "optimal"  choice  for  Q, 

As  we  increase  Z.  gradually,  scaling  the  entire  matrix  Z,  by  factors 
A A 

of  1.1,  2,  6,  15  and  30  progressively,  we  find  first  that  the  optimal  cost 
* 

J increases  (Fig.  8).  This  is  reasonable  physically  since  the  system 
becomes  increasingly  difficult  to  control  with  increasing  uncertainty. 

We  find  the  other  variables  behaving  reasonably  too.  For  example,  the 
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Fig. 8.  Optimal  cost-to-go  vs.  time,  F.q . (A.  13),  for  N = 15. 

a is  the  scale  factor  for  the  covariance  matrix  Z . 
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quality  of  the  state  trajectory  drops  and  we  find  in  some  sense  a greater 

expenditure  of  control  energy  (Fig.9-10)  .The  behaviour  of  the  sensitivities 

does  not  show  any  useful  regularities  as  can  be  seen  by  carefully  studying 

Tables  8 and  9.  Since  the  relative  sensitivity  is  given  by  yj* . y*  and 

3J* 

o and  J*both  increase,  and  the  change  in  yj  itself  is  hard  to  guess,  we 
are  left  without  any  reasonable  predictions.  For  example,  the  first  row 
of  Table  8,  which  shows  the  values  of  Cf(a^)  as  the  scale  factor  a of  Z^ 
increases,  indicates  that  0(a^)  increases  as  a goes  from  1.1  upto  15  and 
then  drops  at  a = 30.  Similarly,  the  third  row  shows  that  o(a^)  increases 
till  a = 6 and  then  drops  for  a = 15  and  a = 30.  The  second  row  keeps 
increasing  whereas  the  fourth  row  behaves  like  the  first.  However,  there 
is  no  identifiable  pattern  which  allows  us  to  predict  the  behaviour  of 
these  sensitivities.  Also,  since  the  values  of  Z A are  very  small,  even 
a scale  factor  of  30  does  not  succeed  in  making  blow  up.  We  are  still 
within  the  threshold  even  though  we  do  not  know  exactly  what  it  is. 

To  sum  up,  we  could  say  that  the  outcome  of  the  analysis  on  this 
model  is  basically  positive.  There  are  no  really  sensitive  parameters, 
so  we  can  trust  the  results  of  the  model  (on  the  assumption,  of  course, 
that  the  underlying  economics  is  accurate). 

4.5  Conclusion  : 

In  this  chapter,  we  have  presented  a simple  macroeconomic  model  of 
the  U.S.  economy  and  recast  it  into  state-variable  form.  Next,  we  have 
applied  the  equations  developed  in  Chapters  2 and  3 to  this  model,  and 


investment  ($  B)  consumption  ($  B) 
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05  10  15 

time  (in  quarters) 

Fig.  9.  State  trajectory,  Eq.  (3.3.11).  Comparison  of  trajectories 

for  C.E.  case  with  the  stochastic  case  when  E,  is  scaled  by 

A 

a factor  of  30.  Q = (2,1)  for  all  curves. 
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presented  some  empirical  results  together  with  a discussion  of  these 
results. 

Our  model  turns  out  to  be  fairly  insensitive  to  parameter  uncertainty 
variations  and  therefore  quite  reliable.  Applications  of  this  method  to 
more  models  is  required  for  a better  understanding  of  the  equations  we 
have  developed.  It  seems,  however,  that  the  complexity  of  these  equations 
and  their  relative  resistance  to  deeper  insight  makes  this  method  of 
approaching  sensitivity  issues  undesirable.  The  computation  involved 
increases  at  a prohibitively  untranmelled  rate  as  the  dimension  of  the 
model  increases  and  since  most  useful  econometric  models  are  large,  this 
method  is  not  quite  practical.  It  can,  however,  be  useful  when  a small 
subset  of  the  parameters  in  a large  model  needs  to  be  analysed  for  its 
sensitivity.  This,  of  course,  is  to  be  expected  since  this  method  is 
essentially  a brute  force  way  of  identifying  sensitive  parameters. 
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CHAPTER  5 

l 

CONCLUSION 

5.1  Summary  of  Results 

In  this  report,  we  have  investigated  the  structure  of  optimal, 
linear,  random  parameter  systems.  We  model  these  parameters  as  white 
stochastic  processes.  Thus,  the  model  contains  both  additive  and 
multiplicative  white  noise.  This  white  parameter  approach  to  adaptive 
stochastic  control  is  important  for  two  reasons.  Firstly,  it  makes  the 
problem  solvable  analytically.  The  general  adaptive  control  problem  is 
in  fact  a nonlinear  stochastic  control  problem  and  cannot  be  solved 
without  making  approximations.  Secondly,  it  shows,  in  a worst  case 
sense,  the  fact  that  the  control  gains  of  an  optimal  stochastic  system 
with  purely  random  parameters  depend  not  only  upon  the  mean  values,  but 
also  upon  the  variances  of  the  random  parameters.  The  scalar  case  of 
this  problem  was  investigated  by  Ku  £ 1 ] . Here  we  investigate  the  most 
general  multivariable  version.  The  problem  is  formulated  as  a tracking 
problem  and  includes  additive  noise  as  well.  We  do  this  work  in 
Chapter  2. 

In  the  next  chapter,  we  develop  sensitivity  equations  to  analyse 
the  sensitivity  of  the  system  performance  to  small  variations  in  the 
variances  of  the  system  parameters.  The  equations  turn  out  to  be  fairly 
cumbersome  in  the  general  multivariable  case.  Deriving  equations  for  the 
sensitivity  of  the  optimal  control  and  the  optimal  trajectory  turns  out 
to  be  hopelessly  complicated. 
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We  describe  a simple  macroeconomic  model,  recast  it  into  an 
optimal  control  framework,  and  make  a thorough  investigation  of  its 
structure  and  of  the  optimal  solution  together  with  the  sensitivities 
of  the  different  parameters.  We  present  some  of  the  relevant  simulation 
results  for  the  analysis. 

t 

5 . 2 Conclusions  : 

The  multivariable  case  for  linear  random  parameter  systems,  though 
solvable  analytically,  turns  out  to  be  somewhat  opaque  and  does  not 
yield  much  further  insight  than  the  scalar  case.  The  main  result  for 
the  scalar  case  described  in  Ku  [1]  is  the  Uncertainty  Threshold 
Principle.  In  the  scalar  case  it  is  possible  to  find  an  analytic 
expression  for  this  threshold  (some  function  of  all  the  means  and 
covariances).  In  the  multivariable  case,  we  find  that  it  is  very 
difficult,  if  not  impossible,  to  obtain  an  analytical  expression  for  the 
threshold.  The  source  of  the  problem  is  that  we  are  dealing  with 
matrix  quantities  and  matrix  multiplication  is  non- commutative  and 
operations  like  the  trace  of  a product  of  matrices  do  net  decouple. 

However,  a threshold  certainly  exists  as  can  be  verified  by  trying  out 
different  values  for  the  various  mean  and  covariance  matrices. 

The  sensitivity  equations,  since  they  are  derived  from  the  above 
optimal  solution,  turn  out  to  be  even  less  amenable  to  any  insight.  We 
do  not  even  bother  to  reproduce  the  equations  for  the  sensitivities  of 
the  optimal  control  and  state  trajectory.  The  application  of  these 
equations  to  Abel's  model  also  turns  out  to  be  of  dubious  value.  Though 
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they  do  supply  us  with  some  valuable  information  - that  the  model  is 
basically  insensitive  and  therefore  reasonably  reliable  - it  is 
questionable  whether  such  a brute  force  approach  to  sensitivity  analysis 
is  worthwhile.  Many  currently  popular  econometric  models  are  large  and 
nonlinear  and  this  approach  would  become  far  too  involved  computationally. 
The  cpu  time  depends  geometrically  ('vn2)  on  the  order  of  the  system  and 
linearly  on  the  time  horizon.  However,  if  we  restrict  the  set  of 
parameters  whose  sensitivities  we  wish  to  examine  to  a small  subset  of 
all  the  parameters,  then  we  can  hope  to  extract  some  useful  information 
at  a reasonable  cost. 


5.3  Suggestions  for  Future  Research  : 


1 . More  analysis  is  required  to  thoroughly  understand  the 

different  aspects  of  tracking  problems.  Specifically,  one 
needs  to  understand  the  end-point  behaviour  of  various 
variables  like  x^,  ut,  Lt  and  m^  physically.  It  may  help 
to  reduce  these  matrix  and  vector  quantities  to  scalars 
by  using  suitable  norms. 


3Kt 

2.  We  have  calculated  quantities  like  ~r  . It  may  be  useful 

3Kt+e 

to  consider  quantities  like  ^ as  well.  This  represents 
the  effect  of  a change  in  the  present  value  of  a on  the 
future  value  of  Kt>  This  may  prove  to  be  useful  in 


adaptive  control  schemes  where  such  information  may  be  used 
to  guide  control  action. 
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3.  Though  the  equations  turn  out  to  be  very  complicated,  it 

3Zut  9£xt 

would  be  useful  to  look  at  the  behaviour  of  “T-  , "r-  . 

do  do 

Perhaps  somewhat  different  initial  assumptions  might  lead 
to  a more  tractable  problem  which  might  yield  useful 
information. 

4.  The  scheme  developed  in  this  report  can  be  applied  to  assess 
the  reliability  of  different  models  of  a given  system.  This 
affords  a selection  criterion  which  can  aid  in  choosing  one 
out  of  a number  of  models. 

5„  This  sensitivity  analysis  can  also  be  applied  to  an  analysis 
of  the  monetarist-fiscalist  debate  in  Abel's  paper  [47]. 
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APPENDIX  A 


We  solve  here  the  optimal  control  problem  posed  in  Chapter  2 
using  the  method  of  stochastic  dynamic  programming. 

We  begin  by  stating  the  problem  and  the  principle  of  optimality. 

We  have  the  following  linear  random  parameter  system  : 


Xk+1  = Vic  + Bkuk  + ck 


xq  given 


(A.l) 


where  A^,  Bk  and  c^  are  all  white  and  Gaussian  with  known  means. 


covariances  and  cross-covariances. 


E {Ak>  = A 

E {B.  } = B 

k 

E {ck}  = c 

E { [ S(Ak)  - S (A)  ] [ S(A£)  - S (A)  ] } = 6 u 

E { [ S(Bk)  - S(B)  ] [ S(B£)  - S(B)  ] } = ZB  6k£ 

E { [ S(ck)  - S(c)  ] [ S(c4)  - S(c)  ] } = Ec  6k£ 

E { [ S(Bk)  - S(B)  ] [ SIA^)  - S (A)  ] } = 

E { [ S(Bk)  - S(5)  ] [ S(c4)  - S(c)  ] } = ZBc6kJl 

E { [ S(Ak)  - S (A)  ] [ S(c£)  - S(c)  ] } = EAc6k£ 


Here  we  introduce  some  notation  for  convenience.  For  any  matrices  Yk,Zk 
let 

E ( HzkYv 1 • Wk 

= Y’ZkY  if  E { Yfc  } = Y constant 
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The  cost  functional  we  choose  to  minimize  is  : 


. N-l 

2 E I l Uxk  - xk)'Q(xk  ' + (uk  ‘ \),R(uk  " “k^ 


* (XN  ' V,QlXN  - V > 


where  Q,  R are  symmetric,  positive  semi -definite  matrices  and  where 


are  given  target  trajectories. 


The  stochastic  control  problem  is  to  find  a control  sequence 
{ uq,  Uj,  ...  , u^  j } that  minimizes  the  value  of  J.  This  problem  is  the 
stochastic  tracking  type  of  optimization  problem  and  can  be  solved  with 
either  the  discrete  minimum  principle  or  dynamic  programming.  We  choose 
the  second  approach. 

Let  Jt  • 7 l.k  - V ♦ <ui-i  - - °i-i>  I 

h * 7 1 (xk  • 5k>,|5(xk  - V * <vrVi,,R(vrVi’ ' 

\ = E { Jk  } 

\ - E < Pk  > 


where  k = 1 , 2 , ...  , N 


We  have 


k = 1,2,  ...  , N 
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min 

Uk-1 ' ' ' ' ,UN-1 


mm 
u 


k-1 ' ‘ 


» u 


N-l 


min 
u 


k-1 ’ * ‘ ’ ,UN-1 


EJ, 


E (P,  + P.  . + 
v k k+l 


EP,  + min 
k 


. + p ) 

V 


EJ 


VvVi 


k+l 


min  EP^  + min 
Uk-1  uk-l 


min  Ak  + min 


min  ( Ak  + Yk+1  ) 


(min 

V 


Vi 


(N°te  : EJn+1  = 0) 

EJ,  i) 
k+P 


Y 


k+l 


(Note  : yn+1  = 0) 


k- 1 


(A. 3) 


This  is  the  functional  recurrence  relation  that  we  shall  use  in  our 
derivation. 


We  shall  first  calculate  A^. 

Xk  = EPk 

= / Pk  p(xk)  dxk 

= 2 ^ (xk‘xk5'Q(xk"xk)  * ^uk-rVl),R(uk-ruk-l)  ^ * 

P^k^-l’VrVl'^-l^^k-l’Vl’Vl'P^-l1 

d(xk,Ak-l,Bk-l’ck-l,xk-l) 


using  p(x)  = f p(x/y)  p(y)  dy. 


Ill 


Note  that  is  independent  of  ^ , B^,  1 so  we  can  write 

p^Ak-l’Bk-l’Ck-l’Xk-l^  = P^k-l^k-l’S-l5  P (Xk-l5 
Also,  d(xk>  A^_^,  B^_1>  c^_^,  xk_^)  is  merely  an  abbreviation  for 
dxkdAk-ldBk-ldck-ldxk-l* 

Therefore, 

\ = 7 / [ xk-i(Ak-iQAk-i)xk-i  + "k-i^k-i^k-i5  Vi 

+ ck-lQck-l  + 2uk-l(Bk-lQAk-l)xk-l  + 2uk-l (Bk-lQck-l5 

+ 2xk-l(Ak-lQck-l)  + *kQXk  + VlRVl  - 2Gk-lRuk-l 

2xjt(QAk-l)xk-l  * 2xk(QBk-l)uk-l  " 2 xk(Qck-P  ^ • 

p(Ak-rBk-rcn)P(Vi)d(Ak.r^rck-i’Ik-i) 

using  xk  = Ak_1xfc_1  + Bk_1uR_1  + ck_1  and  integrating  out  xk* 


Now,  integrating  with  respect  to  A,  , , B,  ,,  and  c,  , we  get 

K-l  k-1  k- 1 

\ = i / f Vi + uk-i(R  + Vi + 

+ ♦ 2u^_1(BrQF)  ♦ 2x^_1(TrQO 

+ xkQ\  + Sk-iRVi  - 2 ak-i%-i 

- 2x£QAxk_1  - 2x^QBukl  - 2x£Qc  ] P(xk_1)dxk_1 
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k = N 

★ 

YN 


min  \ 
UN-1 


N 


<Vl  5 0) 


dV 


= 0 


du 


N-l 


2(R  + B’QB)un_1  + 2(B’QA)xn_1  + 2(B'Qc)  - 2RuN_x  - 2B'QxN  = 0 


>-1 


N-l 


- (R  ♦ B'QB)'i(B'QA)xN_1 

- (R  + FQBr^B7^  - B'Qxn  - Run_ x ) 


With  this,  we  calculate 


J /[  XN-l(A'^XN-l  + ^.1(A'Qb)CR*B'QB)-1(B'QA)xn_1 


+ (B'Qc  - B'Qxn  - Run  x)' (R+B'QB)'1(B'Qc  - B'Q*N  - RG^) 


+ 2xN_l(B'QA)' CR  + B'QB)’1(B,Qc  - B'Qxn  - Run_ x ) 


♦ c’Qc  - 2x^_1(A'QB)  (R+B'QB)"1(B'QA)xn_1 


- 2 (B'Qc  - B'Qxn  - Run_1) ' (R  + B’QB)'1 (B'QAJx^ 

- 2 Xjjj_x  (A^QB)  (R  + B^^FqG) 


- 2 ( B ' Qc  - B'Qxn  - RuN1)'(R  ♦ B'QB)-1 (B'Qc) 


+ 2 + *N  *N  + WVl 


-1 


+ 2 u^_1  R(R  + B'QB)"  (B'QA)  xN_J 


2 ^-1R  (R  + B'QB)*1  (B'Qc  - B’Q*n  - Ru^) 


2 *nQAxn-i 
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+ 2 x^QB(R  + B'QB)  (B'Qc  - B'Qx^  - Ru  ) 


- 2 x^Qc  ] p(xN_:)  dxN_1 


On  simplifying  the  above,  we  get. 


ff  I x^-i  (A  'QA  - (A'QB)(R  + B'QB)-1  (B'QA)  } x^ 


♦ 2XjJ|_1  {A'Qc  - A-Qxn  - (A'QB)  (R+B'QB)-1  (B'Qc  - B‘QxN~  Ru^)} 


- (B'Qc  - B'Qxn  - RGn_1)'(R*B'QB)  (B'Qc  - B'QxN  - Ru^) 


+ C’QC  + XNQXN  + UN-1RUN-1  - 2 XNQe  1 P(XN-l)dXN-l 

Since  we  know  the  final  answer,  we  can  make  some  convenient  definitions  at 
this  point. 


Let  K 


N 


Then, 


Now  define 
D. 


-<*N 
7 XNQiN 


\ I [ ^.i(AV  - A'KnBCR  * B'l^B)'1  B'K^)  x^ 


♦ + A'PN  ' (A’KnB)(R+B'KnB)  (B*  KjjC  ♦ B'pN-  R&n_1) 


-1 


- (B,KNC  * b'pN  - RuN-i),(R+B’KNB)  (b,|(nc  * b'pn  - %-!> 


c'Knc  ♦ 2gN  ♦ u'_1RGn.1  ♦ 2c'pN  ] p(xN_1)dxN_1 


-1. 


N-i-i  ■ *'Vi*  - (A'ViB)(R*B'Vi6>  (“'S-i4’ 


qN-i-l 

— 

A'*N-ie  + A'PN-i  ' fA,KN-iB)(R+B’KN-iBr 

(B'KN-iC  + B’PN-i  - S-i-l> 

K. 

l 

= 

Q + D. 

l 

pi 

= 

- Q*i  + 

Li 

= 

- (R  ♦ B'K.+1B)_1  (B'Ki+1A) 

m. 

l 

= 

- (R  • ••Ki,1B)'1(R'Rinc  * B'piH  . Rfi.) 

rN-i-l 

= 

7 (B'KN-ic  * B'Vi  - RVi-l>'  Vi-1  * 2 

+ I5N-i-lRVi-l  + =’PN-i  + gN-i 

gi 

= 

7 4 ri 

Thus  we  can  write 

YN  = 2 + 2XN-lqN-l  + 2rN-lJ  p(XN-l)dXN-l 

UN-1  = LN-1  XN-1  + “n-I 

From  here  we  go  on  to  the  next  step  in  our  calculation. 


2.  k 


N - 1 


YN-1  = min  (XN-1  * V 

v2 
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We  have,  from  the 
* 1 


2 


♦ 


■¥ 


♦ 


♦ 


1 

2 


♦ 


after  integrating 
Therefore, 


* 


previous  step, 

/[  xN-1DN-1XN-1  + 2xN-lqN-l  + 2rN-l-*  P(XN-l-)aXN-l 
h XN-2(AN-2DN-lAN-2')XN-2  + UN-2BN-2°N- 1 BN-2UN-2 


CN-2DN-lCN-2  + 2uN-2BN-2°N-lAN-2XN-2 


2uN-2BN-2°N-1CN-2  + 2XN-2AN-2DN-lCN-2 

2iN-2AN-2qN-l  + 2 UN-2BN-2qN-l  + 2cN-2qN-l 

2TN-1^  p(xN-ll  AN-2,BN-2,CN-2’XN-2-)p(:AN-2,BN-2,CN-2) 
P ^XN-2^d(XN- 1 ,AN-2 ,BN-2 ,CN-2 ,XN- 2^ 


/[  xn_2A'DN-1A  XN-2  + UN-2B'DN-1B  UN-2  + C'°N-1C 


2 UN-2B'°N-1A  XN-2  + 2 UN-2B'DN-1C  + 2 XN-2A'DN-1C 


2 XN-2A’Vl  + 2 UN-2BVl  + 2 C’qN-l  + 2rN-l] 

p(XN-2)dV2 

with  respect  to  x^,  2>  BN_2>  and  cN_2> 


7 / &*_,  < *' « * Vl)A  1 xN-2 

* ♦ Dn-1,B)  V2 

+ c'  (Q  + Dn_1)c 

* 2 “n-2  B'(Q  + *WA  XN-2 
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2 uN-2  B'«  + IWC 


+ 2 XN-2  A’  « + <WC 


2 XN-2  A'^qN-l  " ^XN-1 ^ 
+ 2 UN-2  ?'(qN-l  - QVl} 
+ 2 C'  (qN-l  ‘ 


+ 2 r, 


N-l 


+ ^N-l^N-l  + UN-2RUN-2  " 2 °N-2RuN-2J 

p(XN-2)dXN-2 

I ^ XN-2(A'KN-lA)XN-2  + UN-2fR+B'KN-lB-)UN-2 


* C,KN-1C  + 2 * 2 UN-2B,KN-1C 


+ 2X^-2A,KN-1C  + 2 XN-2A,pN-l  + 2 UN-2B'PN-1 

+ 2 PpN-l  + 2 rN-l  + XN-lQVl  + aN-2%-2 


- 2 UN-2RuN-2  ] P(xN.2)dxN.: 


We  can  now  minimise  this  expression  w.r.t.  u. 


N-2 ' 


duN-2  ‘ Xn-‘  * Yn  ’ 


2(R  • * 2 BVl4  xN-2  * 2 B'KN-1c 

+ 2 B'PN-1  ■ 2 RuN-2  = 


1 


0 
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UN-2 


• (»  * B'VlB)'llB'KN-lA>  xN-2 

- (R  * B'Kn.1B)-1(B'Kn.1c  . i'pN.j  - Run.2) 
LN-2  XN-2  + mN-2 


Let  us  now  calculate  y 


' N-l 


N-l 


2 / t XN-2fA'KN-lA)XN-2  + XN-2LN-2(R  + B' KN- 1B) LN-2XN- 


♦ m 


1;_2CR+B'KN_iB)V2  * 2 ^.2S.2(R+B-KN.1B)mN_2 


* c'KN-1C  + 2 XN-2LN-2B  KN-1A  XN-2  + 2 mN-2B,|CN-lA  XN-2 


* 2 XN-2LN-2B,,CN-1C  + 2 mN-2B'VlC  + 2 XN-2A VlC 


+ 2 XN-2A'PN-1  + 2 XN-2LN-2B'PN-1  + 2 mN-2B'PN-l 

+ 2 C'PN-1  + 2 rN-l  + XN-1QxN-1  + ^-2^-2 

2 UN-2R  LN-2XN-2  " 2 UN-2RmN-2-'  p(xN-2‘)dxN-2 


2 ^ tXN-2°N-2XN-2  + 2xN-2qN-2  + 2rN-2^  p(XN-2)dxN-; 
after  some  simplification  and  rearrangement  of  terms. 


So  we  see  that  we  get  similar  expressions  for  the  control  and 
optimal  cost-to-go  for  the  next  period.  This  obviously  carries  through 
by  a simple  induction  argument  to  all  time  periods.  Thus  we  can  write 
down  the  complete  solution.  Before  we  do  this  we  eliminate  some  of  the 
new  variables  we  introduced  earlier. 
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A'K.A  - (A'K.B)(R  + B'K.B)'1  (B'^A) 


Q + D. 
1 


Q + A'K.  A + (A ' K.  , B)  L. 

l+l  v 1+1  1 i 


A'K.c  + A'p.  - (A'K. B) (R  + B' K. B) * 1 (B ' K. c + B'p. 

l 'll  li  *i 


- RVi> 


Qxi  * 


- Qx.  + A’K.  ,c  + A'p.  , + (A'K.  .B)  m. 
x l l+l  *i+l  k l+l  ’ i 

(B'K.c  + B'p.  - Ru.  )'  m.  . + -^  c'K.c  + c’p. 
2 i *i  l-l'  l-l  2 l *i 


+ iu!  ,R  u.  . + g. 
2 l-l  l-l  6i 


1 x!  Qx.  + r. 

2 l l l 

4 x!  Qx.  + ^ u!  Ru.  +4  c'K.  ,c  + c'p.  , 
2 l i 2 i i 2 l+l  *i  + l 

+ i (B'K.  ,c  + B'p.  . - Ru.)'  m.  + g.  , 

2 l+l  *1+1  l 6i+l 


The  complete  solution  to  the  optimization  problem  is  therefore  : 


LtXt  + \ 


- (R  + B'Kt+1B)'  (B'Kt+1A) 

- (R+B'Kt+1B)_1(B'Kt  + 1c  + B'pt  + 1 - R\) 

- Qit  - A'Kt+1c  + A'pt+1  + (A’Kt+1B)  mt 


(A. 5) 


Q ♦ A'Kt+1A  + (A'Kt+1B)  Lt 


(A. 8) 
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I 5c;Qxt  * \ u;Rut  * j ~ «t  + 1 


c'K  c + c'p 


t+1 


s 

pn 

£\j 


and  t 


+ 2 (B'Kt+lC  + B'Pt+l  - R5t5,  mt  + gt  + l 


<*n 


2 *NQ*N 


0,1,2,  , N-l 


(A.  9) 

(A. 10) 
(A. 11) 
(A. 12) 


We  can  also  calculate  the  value  of  the  optimal  cost-to-go  and  the  optimal 
cost . 

The  optimal  cost-to-go  is  given  by  : 

“k  ■ \ * iE  i <vi  - ;k-i,,Q(Vi  • vd  1 

’ i I Ixk-i  Dk-i  xk-i  * 2 xk-i\-i  * 2 rk-ii  »lxk-i,dxk-i 
2 f fxk-lQxk-l  ' 2 xk-lQxk-l  + xk-lQxk- 1 3 

P(xk-l)dxk-l 

= I / K-1(Q  + Dk-13  Xk-1  + 2 xk-l(qk-l  ' Qxk-P 
2 rk-l  + Xk-lQxk-l^  p(xk-l)dxk-l 

2 ^ ^Xk-1K k- 1 Xk- 1 + 2 P^- lXk- 1 + 2 gk-l)p(xk-l}dxk-l 

E { 2 Xk-lKk-lXk-l  + Pk-lXk-l  + gk-l  * k = 1,2 N 


(A. 13) 
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The  optimal  cost  is  given  by  J = a 


1 


{ | x'K  x ♦ 


l o o O 0 0 


go  } 


Since  xq  is  known  with  certainty  we  can  write 


-=■  x'Kx  + p'x  + 2 

2 ooo  *o  o 


(A. 14) 
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APPENDIX  B 

COMPUTER  SUBROUTINES 
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?IL*:  PAP.MN  FORTRAN  A 


CONVERSATIONAL  il  ON  IT  Or.  SYSTEM 


C 


c 


INTEGER  N a,  NS  ,NNA  , R PT  S , N , M , NM , N N , I PVT  (10)  , KIN  , KO  UT 

DOUb  LE  PRECISION  A ( 1 0 , 2}  , B ( 10,  2)  , C ( 1 0 , 2)  , Q ' 1 0 , 2)  , R ( 1 3 ,2 ) , 

♦ S IGA  (7 ,4)  ,S  103 '1  2#  4)  , S IGO&  ( 1 2,  4)  , SI  SC  ( 1 0,  2)  , 

♦ SIGAC  (7, 2)  , 5IG8C  ( 12,  2)  ,PI  ( 12)  , GT,  XZERG  ( 10)  , 

♦ XI  (12)  ,UT  (12)  ,D(1C,2)  ,2KT(10,2)  , £L(1Q,2)  , EM(10)  , 

♦ J (10,2)  , V (10, 2)  , W ( 10, 2) , W1  (10)  , W2( 10) , WOEK  (10)  , 

♦ Vw  (1  0,  2)  ,UVW  (1  0,2)  , A PRAY  (51  ,1  0)  , 

♦ dKB  (15 ,2)  , DKA  ( 10,  2)  , BPB  ( 10, 2)  , 

*■  UP  A(1  0,2)  ,LC0ST  (2  0)  ,CGST  (20)  ,8  PC  (10)  , 

♦ 3 L>  P (10  ) , ON  (10)  ,DP  (1C)  , 3KC  (10)  , OG 

CCMMON/INO  U/KIN ,KOUT 

KIN  = 5 
KOd  T=o 
NA=  10 
N N = 4 
NM=  4 

na=  i 
NS  = 1 2 
NN  A=  7 
N=2 
>1=2 

CALL  MATIO  (SA,N ,N,0  ,4  ) 

CALL  MA  TIG  (NA  ,M,M,R,4) 

CALL  M A Tic  (N  A,N  ,N,A  ,4) 

CALL  MA  TIO  (NA,N,M,B  ,4) 

CALL  a AT  10  (N  ,N,aa,c,4) 

CALL  MAT  10 (NNA , NM, NM, 3IGA,4) 

CALL  MAII0(NS,NM,NN,SIGB,4) 

CALL  MA  T 10  (N  A , N , N,  SIGC,  4) 

UI(1)=0.0L>0 
UT  (2  ) = j .OU'J 
XZERC  (1  ) =362  .GLO 
XZ^FO  (2) =30. 0D0 
NPTS  =1  o 

XT  (1)  = ( ( 1.  0125D0)  **  (NPTS-1)  )*XZERO  (1) 

XT  (2)  = ( (1.0  1 25u'J  ) **  (NPTS-  1)  ) *XZEHO  (2) 

CALL  PAR ( NA,  NS, NN A, NPTS, N, M, NM , NN , A ,B  ,C  ,Q ,fi ,SIGA ,SIG3  , 

♦ SIGBA.SIGC , SIGAC, SIGBC, XT, UT , PT , GI , XZERO , D , SKT , 

♦ EM,  EL,  ARrAY,  COST  , LCOST  ,B  KB  , B KA  , BPA  , B PB  , Ed,  DP, 

♦ 8PC,3DP,3KC,DG,U,V,w,  VW, UVU, W 1 , W2 , WORK, I? VT) 

WnlTLlKOJT,  15)  GT 

15  PGRMAI  (1  HO  ,7H  GT  = ,D26.  16) 

W RITE (K GUT,  1 6) 

16  FORMAT  (1H) ,5H  PT  ) 

CALL  MA  JIC  (N,N,MM,PT,3) 

WRITE  (KUUT,  17) 

17  FORMAT  (1H0,7H  M (T)  ) 

ChLL  MATIO(6#N,MM,EM,3) 

WRITE  (KOUT ,13) 

13  FCRMAT(  1.30,  7H  L (T)  ) 

CALL  MaI  10  (NA  , M , N ,E  L,  3) 

W RITE  (K  GUT,  1 9) 

19  FORMAT  (1  il  , 7 U K (T ) ) 


P AROc 010 
PAR00020 
? AR9co39 
PAR  00  040 
P AF.0U05  0 
P A 2 0 U 06  0 
PAE0U070 
PAR  00080 
PAP.0U090 
P AEOolOO 
PAROO  110 
? AR  J 1 2 0 
PAROO  130 
PAROO 140 
PAR00150 
PAROO  160 
? AR0o17u 
PAROO  180 
PAROO  190 
PAROO  200 
PAROu  210 
P A R 0022  0 
PAROO  230 
P AROC  240 
PAROO 250 
P ARC  v 26 0 
PAR00270 
P ARGO  28  >) 
PAR0G290 
PAROO  300 
PAR0O31 0 
PAROO  320 
? AR0C  33C 
PAROO  340 
PAR0O35C 
PAR00360 
PAROO  370 
PAR  003  80 
PAROO  390 
PAROO  400 
PARC 04 10 
PAR0U420 
PAROO  430 
PAR  0o44  0 
PAEU0450 
P ARC l46  0 
PAR00470 
P AROC 48  0 
PAROO  490 
PAH00500 
PAR005  10 
PAROU  520 
P AR  00  53  0 
PAROO  540 
P ARG3550 


n n n 
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FILfc:  PAtwIU 


'GhTEAN 


CCN  V ESSATION  AL  flGNITOE  SYSTEM 


CALL  HA  TI  Q ( M A , N # M , LK  1 , 3 ) 
STOP 

LAST  LI ML  OF  P A RUN 
iiMD 


PAROC  560 
P AEOv.57 
PAEUu  5y0 
P AR  J v 5 9 'j 
PAE00600 
? Afi 00  fa  1 0 


J (.)  U 'J  -J  L) 
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F1L  E : ?<tR  .-OnIHAN  A 


CONVERSATIONAL  MONITOR  SYSTEM 


c 


c 

c 

c 

c 

c 

c 

c 

w 

c 

c 

c 

c 


SUlSgUI  IN-  P AF.  (NA,NS,NNA,  N PT3,  14,  M,  NM,  NN  , A,  3,  C,  y,  E , SIGA  , S IGB, 

♦ S1G3A,SIGC,S1GAC,SIGBC, XT  ,UT  , PT  ,3  T,XZ  ELO, 

♦ D K , gKT,  Eft,  EL  , A a FA  I ,CG  ST.LCO  ST,  BKB,BK  A,  SPA, 

♦ BP  3, DM,  DP,  3PC,  33?  ,bKC  ,DG,U,  V,  W,  VW,UVW  ,W  1 ,542, 

♦ WORK  , I PVT ) 


PAR0G01  0 
PAK0C020 
PAR  00  03  0 
PARJ J 040 
? AF.  JG  05  0 
PAP.OC  u6C 
? AK  0 1 j7  0 
PAR00080 
? AEuC  'J90 
PAr.OO  TOO 
PAF.Oc  110 


****«[>  ar  AHETZRS: 

INIEGEr.  .4 A , NS,  N14A,  N ?TS,  N,  H , NK , NN  , I P VT  (N  ) 

DOUBLE  P A E C i S XG  N A (NA  ,14)  ,B  ( NA  , M ) ,C  (NA,N)  ,y(NA,N)  ,K  ( N A,  & ) , 

♦ SIGA  (N  NA , NN)  , SIGB  (NS,N  M)  ,SIGBA  (NS, 14)  , 

♦ SiGC  (N  A,  N)  ,S IGAC  (N  NA  , N)  ,SIG3C(NS,  N)  , 

«•  X r (N)  , UT(M)  , PT(N)  , GT,  XZLEO  (N)  , DK  (N  A,  N)  , LKI  ( N A , N ) ,PAH00120 

♦ EL  (N  A,  N)  , ARRAY  (J4PTS,  1 ) ,CGST  ( NPTS)  , LC  OST  (N  PTS)  , PAROO  130 

♦ EH  (M)  , 3K3(  NA,  a)  , 6KA(NA,N)  , BPA(NA,N)  , 6PB(NA,  M)  , PAR0^140 

♦ J (NA,14)  , V (NA,  N)  , W (NA  ,N)  ,VK  (NA  , N)  , U V W ( N A , N ) , W 1 ( N)  , PAROO  150 

♦ * 2 (N)  , D P (N)  , D M (M ) , DG  , 1>  PC  (14  ) , 3DP  (N)  , BRC  (N ) , WORK  (14)  PAS  00160 

PAROO  170 

*****  LOCAL  VARIABLIS:  ? AKCl  18  j 

INI  EG  SF  K,  0,  KK,LL,KIN,KOUT,ITOP  (40,6)  ,IN  (9  ) ,NS  Y S (1 ) ,MSC  , MAXES,  PAROO  190 

♦ I XU  ,JNDEX,I1  ,II5,1£GY,  MM,  NLG  , NG  EIDH , IN  DEX,  I COUNT,  I D,  IL,  P AR0O200 

♦ I ,1NC1 ,IND2 ,IND3,IND4,IB,IS,I1, ITM  1 ,IT 1 , ID , IV , 1 1 , Ic, 14, 15, PAROO 210 

♦ J , J J , J 1 , KL  P AROo  22 v 

DOUBLE  PRECISION  C 0 ND, Tfi,  SU H,  X MIN,  XM AX, YH IN , YM AX, YSF  ( 10 ) , ZERO , PAR00230 

XM,XS1  (2)  ,XS  (2)  , LTS  ( 1 0,2)  , X SA  V £ ( 1 6 , 2)  , PAROO  240 

LTSAVE  (3  0,  2)  , MTSAVE  (30)  , H TS  ( 2)  , XS 2 ( 2)  , PAR0G25 0 

JSAVE( 15,2} , DKS  A VE  (96 , 32  ) , PISA  V £ (3  2 ) ,3TSA  VE  (1b)  , PAROO  260 


-43(1,2)  , D PSA  V-  (96,  16)  , DMSAVE  (9  6,  16)  , 

DGSA  VE  (48 , 16)  ,C3TSEN  , LARS  A Y (15 ,4  ) , HARR  AY  (15,2), 
Eg L SEN  (6  ) , SC 


***** l UNCIIONS: 

I NT  EG  ER  MOD 

DOUBLE  PRECISION  DFLOAT 
♦♦♦♦♦SUBROUTINES  CALLED: 

S AV  L , MA  DD  , MS  U 8 , MMU  L , ay  F,  M SC  ALE  , TEN  ATB,  T fi  ACE  , THP  LT  , L INEQ  , MLI N Ey 


•♦♦♦♦PURPOSE : 

THIS  SUBROUTINE  PERFGRaS  TWO  FUNCTIONS: 

(1)  IT  SOLVES  THE  FOLLOWING  DISCRETE  TIME  LIN  EAR  QUADRATIC 
OPTIMAL  CONTROL  PROBLEM  FOR  A LINEAR  SYSTEM  W II H PURELY 
RANDOM  PARAMETERS. 

THE  SYSTEM  IS  DESCRIBED  BY 

X (T  ♦ 1 ) = A*X  (T)  + B *U  I T)  ♦ C,  X(5)  = XZERO 

A ,3 , AND  C ARE  WHITE  AND  RANDOM. 

THE  MEANS,  COVARIANCES,  AND  CROSS  COVARIANCES  OF 
A,  3,  AND  0 ARE  SPECIFIED. 

I HE  COST  CRITERION  IS 


PAK0O270 
PAROO  280 
P AR JC29G 
PAROO  J00 
P AEQU31C 
PAROO  320 
P AE00  33- 
PAROO  340 
PAK0C350 
PAc0G360 
PAE0G370 
•—PA R 003  80 
PAROO  390 
P AR  G - 4 G j 
PAROG410 
P AR0G42G 
PArOG  430 
P AEUC440 
PAR0o450 
PAROO  460 
? AR  QC  4 70 
PAROO  480 
? AR  0 c 4 9 o 
PAROO  500 
P ARwGSIQ 
PAKOo  520 
? AR0g53  0 
PA  R00  540 
PAROO  550 


o •_>  u u 
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FILL:  ? A 


?c.-;t?an 


CGNVEES  ATICN  AL  MG  NIT  Or.  SYST-M 


C 

c 

c 

c 

c 

c 


c 

V* 

c 

c 

w 

c 


c 


c 

c 


c 

c 

w 

c 

r* 

w 

c 

c 

c 

c 

c 

c 

c 


c 

c 

c 

c 

c 

c 

c 

w 

c 

c 

c 

c 


(2) 


J - (1/2)  *£  (SUMMATION  FROM  T ■=  . TO  N- 1 OF 

T 

(X  (T)-XTILDA  (T)  ) *0  * (X  (T)  ~X  I ILDA  (T)  ) ♦ 

T 

(U  (T)  -UTILEA  (T)  ) *R  * (U  (T) -UTI  LDA  (T)  ) ) ♦ 

T 

(X  (N)  -XTILDA  (N)  ) *0*  (X  (N  ) - XT  ILDA  (N  ) ) 

Tii  L I A LG  ET  SEQUENCES  (XTILDA  (T ) ) , ("JT  ILD  A (T ) ) , 1=0,1,  . . N 

MUSI  OZ  SPECIFIED  ALONG  WITH  0 AND  R. 

IT  CALCULATES  TtiE  QUANTITIES 

PARTIAL  DERIVATIVE  OF  JSTAR  WITH  RESPECT  TC  SIGMA  AND 
THE  PARTIAL  DERIVATIVE  OF  JSTAR  WITH  RESPECT  TO  SIGMA  * 

(SlG  MA/JSTA  EL) 

WHERE  JSTAR  IS  THE  OPTIMAL  COST  (03TAINLD  FROM(1))  AND 
SIGMA  IS  AN  ELEMENT  CF  ONE  OF  THE  COVARIANCE  MATRICES 
SIGA,  SIGB,  OR  SIGBA.  THIS  GIVES  THE  ABSOLUTE  AND  RELATIVE 
SENSiriVIES  CF  THE  OPTIMAL  PERFORMANCE  TO  VARIATIONS 
IN  THE  PARAMETER  VARIANCES. 


PAR  0o56'> 
PA  aOO  57  0 
PAR0C53C 
PAR005U0 
P AnOO  bQ  0 
PAR  0o6 1 0 
PAROo  020 
P AR GC63C 
PAcOO  640 
? AR  \j  o o 5 0 
PAROO  660 
? AR00670 
PAR00680 
PAROO  b9Q 
PAR  00700 
PAR007  10 
PAROO  72  0 
PAR0073u 
? AEU0740 
PAS00750 
PAROO 76  3 


♦♦♦♦‘PARAMETER 
ON  I N PU  T : 

NA  , NS  , J NA 


NPTS 


N 


M 

NM 

NN 

A 

0 

c 

Q 

a 

SIGA 
SIG  J 
SIG  J A 


DESCRIPTION:  PAR00770 

PAR00780 

ROW  DIMENSIONS  OF  THE  ARRAYS  CONTAINING  A (AN  DP  AR  00  790 
B,C,w  ,R,SIGC,  DK  , EKT  , EL,  3 KB  ,BKA  ,BPA,3PB,U,V,W,  PAROO  800 
VW,UV  W),  SIGB  (AND  SIGBA,  SIGoC)  , AND  SIGA  (ANDPARO08IO 
SIG  AC)  , RESPECTIVELY,  AS  DECLARED  IN  THE  PAR00820 

CALLING  PROGRAM  DIMENSION  STATEMENT;  PAR0od30 

PAR0C840 

NUMBER  OF  POINTS  10  BE  PLOTTED;  PARO0850 

PAROO  8 60 


NUMBER  OF  STATES; 

NUMBER  OF  CONTROLS; 

= N*M; 

= N*N; 

N X N SYSTEM  MATRIX; 

K X M INPUT  MATRIX; 

N X 1 ADDITIVE  NCISE  VECTOR; 

N X N STATE  WEIGHTING  MATRIX; 

M X M CONTROL  WEIGHTING  MATRIX; 

NN  X NN  COVARIANCE  MATRIX  OF  A; 

NM  X NM  COVARIANCE  MATRIX  OF  B; 

N K X NN  ChOSS  COVARIANCE  MATRIX  OF  A 
AND  3; 


P AR  Ood 7 j 
PAR00880 
P AR00890 
PAR0o900 
PAROUS  10 
PAR  0U92  0 
PAK0G93C 
? AR0o94o 
PAROO  9 50 
? ARC 0 96  C 
PAR0U970 
PAR00980 
PAR00990 
PARO  1000 
PAR  01 01 0 
PARO 1020 
? AR  0 1 o3  j 
PARO  1040 
PAR  )1  05  ) 
PARO  1060 
PARO  107  0. 
PA  R 01 080 
PASO  1 J90 
PAR  01 1 00 


-126- 


FILfc:  ? At. 


FCuvTEAN  A 


CONVERSATIONAL  MONITOR  SYSTEM 


XZEEU 


ON  OUTPUT: 


ARFA  Y 


CC  ST 


N X N COVARIANCE  MATRIX  0?  C; 

NN  X N CROSS  COVARIANCE  MATRIX  OF  A 
AND  c; 

N J1  X N CROSS  COVARIANCE  MATRIX  OF  li 
AND  C; 

REAL  VECTOR  0?  LENGTH  N CONTAINING 
XTILDA  (NPTS)  ; 

REAL  VECTOR  OF  LENGTH  N CONTAINING 
UTI  LDA  ' NPTS)  ; 

REAL  VECTOR  OF  LENGTH  N CONTAINING 
THE  VAL  UES  OF  P (NPTS)  ; 

REAL  SCALAR  CONTAINING  THE  VALUE  OF 
G (NPTS)  ; 

INITIAL  CONDITION  VECTOR. 


N X N ARo  AY  CONTAINING  THE  RICCATI  MAIFIX; 

M X 1 REAL  VECTOR  CONTAINING  THE  CORRECTION 
CUM  ThACKING  TERM; 


bKA  , 3 PA 
oKB  , li  PD 


M X N GAIN  MATRIX; 

NPTS  X NN  REAL  SCRATCH  ARRAY  USED  FOE 
PLOTTING  ; 

NPTS  X 1 REAL  VECTOR  CONTAINING  THE  OPTIMAL 
COST  TO  GO; 

N X N ARRAY  CONTAINING  THE  PARTIAL  DERIVATIVE 
CF  EKT  HIT  H RESPECT  TO  SIGMA; 

REAL  VECTOR  OF  LENGTH  N CONTAINING  THE 
PARTIAL  DERIVATIVE  OF  EM  WITH  RESPECT  TO 
SIGMA; 

REAL  VECTOR  OF  LENGTH  N CONTAINING  THE 
PARTIAL  DERIVATIVE  OF  PT  WITH  RESPECT  TO 
SIGMA; 

REAL  SCALAR  E^JUAL  TO  THE  PARTIAL  DtEVIATIVS  0 
GT  WITH  FE5PECT  TO  SIGMA; 

M X N REAL  SCRATCH  ARRAYS; 

fl  X M REAL  SCRATCH  ARRAYS; 


PASO  1 1 10 
P ARC  1120 
PAR01  1 30 
PASO  1 140 
PAR01  150 
PASO  1 160 
? AR  0 1 1 7 j 
PARO 1 180 
? AR  0 1 1 9 0 
PAr.O  1 20  0 
P AR0 1 2 1 0 
PA  RO 1 220 
PARO 1 230 
PAR01240 
PARO 1 250 
? AR  0 1 2b  0 
PARO 1270 
P AR  01  28  ■) 
PAcO  1290 
P AEG  1300 
PAR0131  0 
PARO 1 320 
PAR  01 33  0 
PARO 1340 
? AR01 350 
PARO 1 360 
PAR  01  37  0 
PARO  1 380 
P AHO 1 390 
PAR01 400 
PARO  1410 
PAR  01  420 
PAR01 430 
PAR  01440 
PARO 1450 
P AKv>l46  0 
PARO 1 470 
P AHw 148  0 
PA  SOI 49C 
PARO 1500 
PAR  01 51 0 
PARO 1520 
PAR01  530 
PARO 1 540 
P AB0 155  0 
PARO 1 560 
PARO 1570 
PAaOl 560 
PARO 1590 
FPAR01 600 
PARO 1 o 10 
? AE  0 1 6 2 c 
PARO 1 bJO 
P AR  w 1 6 4 j 
PARO 1 b50 
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P ILi: 


a N A 


CONVERSATION  AL  MONITOR  i YSTLM 


3D? , JPG  , 0 KC 
U,  V,  VI,  V«,rJVW 
* 1 , W2,  WOa K 


i ?v  r 


EE  A L SCRATCH  VLCTCES  CF  LENGTH  N; 

N A N aEAL  SCRATCH  ARRAYS; 

REAL  SCRATCH  VECTORS  OF  LENGTH  N; 

IN  TEG  Eh  SCRATCH  VECTOR  OF  LENGTH  N . 


*****iil  STO-.Y  ; 

WRITTEN  d Y J.A.K.  CAR  RIG, 

(LAB.  FOR  INF.  AND  DEC.  SYS.,  (L  .1  . D.S)  , M.I.T.,  EM.  35-427  , 
CAM  BRIDGE,  HA  021J^,  PH.:  (b17)  - 253-7263), 

JANUARY  1979. 

HOST  EL CENT  VERSION;  JANUARY  11,  1*79. 


CCM.10U/INJU/KIN,  KOUT 
DATA  I BLANK/ 1H  / 

DATA  IN  ( 1|  , IN  (2)  ,1  N (3)  ,IN  (4)  /1H  1,  1 H2,1HJ,1H4/ 

DATA  IN  :5)  , IN  (6)  ,1  N ;7)  ,IN  '8)  ,IN  (9)/1H5,  IHfa,  1H7,  1 H B,  1 H 9/ 

DATA  HOP  (1,  1)  , ITOP  (2,1),  ITOP  {4,  1)  ,ITOP  (5,  1)  , I TOP (6,  1)  , 

♦ HOP  (7,1)  , IICP  (8 , 1 ) ,1  TO  P (9  , 1)  , I TCP  (10,1)  ,ITOP  (11,1),  ITOP  (12,  1)  , 

♦ I TOP  (13,1)  , ITOP  (14,1)  ,ITOP  (15,  1)  ,ITCP  (1  6,  1)  , ITOP  ( 17,  1)  , 

♦ ITOP  (1d,1  ) ,ITC?  (19,  1)  ,1  TOP  (20,  1)  ,ITOP  (2  1,  1)  , ITOP  (22,  1)  , IIOP  (23,1) 

♦ / 1h  , 1HK,  In  , 1HV  , 1HE,  1HR,  1US,  1 HU,  1 HS  , 111  , 1 HT,  1 HI,  1 H H,  1 H E, 

♦ Id  , 1 H , 1 H , 1 h ,1Si  , 1 H , 1 H , 1 ri  / 

DATA  ITOP  (1  ,2)  ,1  TOP  (2,2)  , I TOP  (3,  2)  ,1  TO?  (4,  2)  , I TOP  (5,  2)  , ITOP  (6 ,2)  , 

♦ ITOP  (7,  2)  , I 10?  (8,2)  ,1  TO?  (1  0,2)  , ITOP  (1  1,2)  ,ITOP  (12  ,2)  , 

♦ ITOP  (13,2;  ,ITCP  (14 ,2)  ,1  TOP  ( 15,  2)  ,1  TO  P ( 1 6,  2)  , I TOP  { 1 7, 2)  , ITOP  ( 1 8 , 2) 

♦ ITC?(  19,  L)  , 1ICP  (2  0,  2)  ,1  TOP  (21,2)  ,ITOP  (2 2 , 1 ) , ITO P (23 , 1 ) 

♦ /In  ,1hS,lHT,lKA  ,1HT,  1HE,  1H  ,1HX,1H  , 1H  V , 1HE,  1HE,  IdS,  1 HU,  1 HS  , 1 H , 

♦ 1 HT  ,1HI  , Id  H,  1Ht,  la  ,1H  / 

DAI  A ITOP  (1  ,3;  ,1  TOP  (2,3)  , I TOP  (3,3)  ,ITOP  (4,  3)  , ITOP  (5,3)  ,ITGP  (6,3)  , 

♦ ITOP  (7,  3)  , ITOP  { B,  3)  , ITOP  (9,3)  , ITOP  (10,3)  , ITOP  (1  2,3)  , I TOP  (13, 3)  , 

♦ HOP  (14,3)  , I TCP  (15,3)  ,1  TOP  ( 16, 3)  , I TOP  (17,3)  , I TOP  (Id,  3)  , ITOP  (19,3) 

♦ ITO?  (20, 3)  , ITOP  (2  1,  3)  ,ITOP  (22,3)  ,11  OP  (2  3,3) 

♦/  1 H , 1HC,  1 riO,  1HN,  1HT,  1HR,  IhO,  1HL,  1H  ,1riU,1H  , 1H  V,  1HE  , 1HR  , 1 KS  , 1 HU  , 

♦ 1HS,  1h  , 1HT,  1 HI, 1 HR, 1 HE  / 

DATA  I TO?  (1,4)  , I TCP  (2,4)  , ITOP  (3,4)  ,ITOP  (4,4)  ,ITOP  (5,4)  ,ITOP  (7,4)  , 

♦ ITOP  (8, 4)  , I TO  P (9,4)  ,ITOP  (10,4)  , I T 0 P (11,4)  , I TOP  ( 12,  4)  , ITOP  ( 1 3 , 4)  , 

♦ I TCP  (1  4 ,4,  ,1  TOP  (15 ,4)  ,1  TCP  ( 16,4)  , HOP  (1  7,4)  , ITOP  ( 1p  , 4)  , IT  OP  ( 19 , 4) 

♦ ITOP  (2u,4)  , ITOP  (21,4)  , ITO  P (22,4)  ,ITCP(2  3,4) 

♦/111  , 1 iiG  , 1 HA  , 1 HI  , 1 H N,  1H  , 1H  V , 1 ri  E , 1HR,  1H  S,  1 HU,  1 HS , 1H  , 1 HT  , 

♦ 1 til , 1HM  , 1 HE  , 1 H , 1 H , 1 H , 1 H , 1 H / 

DATA  IT  JP(  1,  5)  ,1  TOP  (2,5)  , ITOP  (4,5)  , ITOP  (5,5)  ,ITOP  (6,5)  , 

♦ ITOP  (7,5)  ,ITCr  (8  ,5)  , ITOP  (9,5)  ,ITO?  (1u,5)  ,ITOP  (1  1,  5)  , ITOP  (12,5), 


PAuO 166J 
PAR  0167. 
PARO 1680 
PAR  0169  . 
PARO 1700 
?An01710 
PAR  01  72  0 
PARO 1730 
PAR  01  740 
PARO 1750 
P AH  Cl  76  •• 
PARO  177„ 
P Afeyl  7 B 0 
PARO  1796 
? ARuldOO 
PAR01810 
-P  ARo1b2- 
PARO 1830 
PARO 1840 
PAR01  B5  0 
PARO 1860 
PAR01 870 
PARO 1o80 
P AF0189C 
PARO  1900 
P AR  0 1 9 1 0 
PARO 1920 
PARO 1930 
PAR01940 
PA  hO 1950 
PAR  01  960 
PARO  1970 
PAR  01 98u 
PARu 1990 
,P  AR  02  cOv 
PAR02010 
P AR  02  02  C 
PARO  20  30 
PAR02O4'. 
PAP.02050 
P ARC  206  0 
,P A R 02 0 70 
P AR02080 
PAR  02 090 
PAR02 100 
P AR  62  1 1 0 
PAR02  120 
P ARO-u  13  . 
,PAR02  140 
P AKu2 150 
P A R u 2 1 6 0 
PAR02  170 
PAF.  02  180 
PAR02  19  J 
P AR  0 2 2 JC 
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FILS:  ?«r. 


FORTRAN  A 


CONVERSATIONAL  MONITOR  SYSTEM 


♦ HOP  Cl  3 ,8)  ,ITCP  (14  ,5)  ,1  TOP (15,  5)  , ITOP  ( 1b,  5)  , ITOP  ( 17,  5)  , IIC?  ( 18,  5)  ,?AE0221 0 


♦ I TjP  (Is,  5)  , I TOP  (20,  5)  , ITC  P '21 , 5)  , II  CP  [22,5)  ,IIOP(23,5)  PAn02220 

♦/Iti  ,1hM,1ii  , lilV  , 1H-,  1HR,  1HS,  ItiU,  1HS,  1H  , 1HT,  1111,  HIM,  1UE,  111  , PAR  0223  0 

♦ In  , 111  , Id  , 1U  , lit  , Iti  , Hi  / PA  P.02  240 

C PAB02250 

DATA  IT  OP  1 1, 6)  , I TOP  (2  ,6)  , ITOP  (3,6)  / ITOP  (4,6  ) ,110?  (5  ,6  ) , I TC  ? (6  ,6  ) , PARC  2260 

♦ ITO  P (7  ,o  ) , I TCP  (8  ,6  ) ,1  TOP  (9 ,6)  , I TO  P ( 10  , to)  , I TOP  ( 1 1 , 6)  , ITS?  (12,0),  P AR  j2270 

♦ ITCP(13,b)  , I TOP  ( 1 4, 6)  . I TO  P ( 1 5 , o ) , IT  OP  (1  6,6)  ,IIOP  (17  ,o)  ,IIC?  ( 18 , 6)  , PAR02280 

♦ ITO?  (14  , o ) , I TO?  (20, b)  ,1  TO  ? (21,6)  ,ITOP  (22,6)  ,ITO?  (23, b)  PAR02290 


♦ /Id  , 1 tiC  , 1 U 0 , 1 H 5 , 1 H T , 1 H , 1 H V,  1 HZ 

♦ 1HM , 1HL , 1M  ,1a  ,1H  ,18  ,1a  ,1.4/ 


M6C=  1 
M A X R S = . 

I X Y = 0 
ISO  Y=1 

Z EE  0=0.  3D  ) 

X MI N=  1.  300 
NOP  IDH=5 
MS*  1 
N L5  = C 

DC  10  1=1,13 

YSF  (I)  = 1.  300 

1j  continue 

DO  20  1=24,  40 

ITOP  (1,1)  =10 LANK 
ITO?  (I,  E)  =1 JLANK 
ITO?  (1,3)  =IaLA N K 
ITCP  (I  ,4  ) =1  B L A N K 
ITOP  (I  , 5)  =I3LANK 
ITOP  (I  ,6  ) =1  BLANK 
20  CONTINUE 
IT=  NPT3 

X M \X=  LFLGA  I'  (II) 

C A l.L  SA/L  (N  A , NA  , N , N,  Q , 2 KT) 

CALL  MMUL  (NA,  N,  N,  MM  , N , N , w , XT,  P T) 
CALL  MSCAcc.  (N  , N , M M , - 1 . j DO  , ? T) 

CALL  M2? (NA , N,N, N,KM, y, XT, «1 , WOaK ) 
OT=  -1  (1)/2.  ODD 
JO  3 0 L = 1 , N 
DC  30  K=  1 , N 

I NDLX  =K^  (L-1)  *N 
A BP.  AY  (II,  IN  OtX)  =2  (K,  L) 

3 0 CONTINUE 
I UD  RX=  I T*  N 

PTSAV2  (INJc.X-1)=?T  (1) 

PlSAVt  (INOlX)  =PT  (2) 

J IS  A VE  UT)  =GT 
I T M 1 =1 T ~ 1 
DO  220  1L=  1 , ITM  1 
IT  1 =1T~ 1 L 

CALL  INNATE  (N  A,  N A,  N,  M,  3,  U) 

CALL  MMJ  L (NA  ,N,  N,  MM,  K,  N,U,  PT,  * 1) 
CALL  MMUL (NA, M, N A, MM ,1 ,M,L, UT, V) 
CALL  M5U3  (N  , NA  , S , M , K rt,  <M , V , * 1) 


1 HI  , 1 US,  1iIU,1  US,  1U  , 1 HI  , 1 H I , PARU2  000 

PAR02  3V3 
PAR  02  320 
PAR02330 
? AR0^34O 
P Aa02  350 
P AH 02 36 L 
PARO  2 370 
P AR02380 
PAR  023  90 
PAR02400 
P AR  02  41«, 
PAK01420 
P ARc243‘3 
PAR  02  440 
PAR02450 
P AR  02  460 
PA  SO  2 47  0 
? AR  02  48  0 
PAR02490 
? AROi500 
PAR02510 
PAROP520 
PAR02  53  U 
PAR02540 
PAR  02 550 
PARO  2 560 
P AR  0 2 5 7 2 
? An 0 2580 
P AR  02590 
PAROzbOG 
P ActO  L b 1 0 
PAR 02  b2  0 
PARO  z b30 
P AR  02  b4  0 
PAR02  b50 
? AR '32  66  0 
PAR02b70 
P AROi68C 
?AR02b90 
PAR02700 
PA  R 02  71  0 
PAR02720 
PAR  (32  73  0 
f AH02740 
? AR  0 1 750 


n n n nr 
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FI Li : PAR 


FOR  "h AN  A 


CONV  tRSATIONAL  tfCNITQR  SYSTEM 


C 


43 


50 

b 0 


7 ) 


C 


00 


C 


90 

C 

c 


CALL  1,WL  'NA,NA,NA,N,:i,N,U,£.KT,  W) 

PAEG276p 

C ALL  iliil!  L (M  A , N A , N A ,X  ,M  , N ,W  , Li , £ K b) 

? AR02  77  j 

CALL  M M'J  L (NA  , NA  , NA  , N,M,  H,W,  A,  OKA) 

PAR0.4  700 

CALL  1MUL  ( N A , N A , N , MM  , M , N , w , C , 3 KC  ) 

P AR02793 
PAR  02  000 

C ALCULAT  d M(T),L(T) 

PAR028  10 
P A£  J z.  0 2 3 

DC  b ) K = 1 ,'A 

PARC  28  30 

KK=  1*  (K-  1)  *N 

PAR02B4  3 

CALL  A MU  L 'NA,  NS, NA,  N,  N,  N,  EKT,  SIGBC'KK,  1)  , W) 

PAROL053 

CALL  TRACE  (NA,N,tf,TR) 

PARO  2860 

OKC  (K)  = 5KC  (K)  ♦«  1 'K)  «-TE 

PAR  02 07U 

DO  4 3 l=  i , a 

PAR02880 

LL=  H (L-  1)  *N 

PAR  02  090 

CALL  MMUL  (NA,NS, NA,N,N,N,EKT ,31GB  (KK.LL) ,W) 

PAR02500 

ChLI  TRACE  (NA,  N,tf,TR) 

? AR02913 

0KB  (K,L)  s-R  (K,  L)  -BKb  (K  ,L  ) -TP 

PARO  *.920 

CONTINUE 

? AR02930 

DC  5 3 L=1  , H 

PA  RO  29  40 

LL=  H ;L-  1)  *N 

PAR02950 

CALL  MMU  L (NA,NS,  NA,  N,  N,  N,£KT,  SIGBA  (KK,LL)  , «) 

P AR  02  9b 0 

CALL  TR  ACE  (N  A,  N,  W,TR) 

PAR02970 

3Ka  (K,  L)  =0  KA  (K,L)  ♦ TF. 

PAR  02  980 

C C N II  N U E 

PAR02990 

CON  T IN  1JL 

PAR  03  000 

CALL  SAV  E (NA  , NA , M , S, BK  B,  W) 

PARO  3010 

CALL  SAVE  (N,a,.l,Mti  ,3KC,£M) 

? AR03  u2C 

CALL  LLN^w  (NA,M,W»  E!l,COND,  1 PVT,  WORK) 

PAR03030 

CALL  SAV  E(il  A,N  A,  K,  M,  BKB,fc) 

? AR03040 

CALL  SAVE  (NA,NA, B, N,BKA,EL) 

PAR  03  050 

CALL  ML  I NEst  (NA,  N A,  M,  N,  W,  EL,  CON  D,IP  VT  ,VICR  K) 

PARO  3060 
? AR03O70 

SAV  c LI  A NC  MT 

PARO  3080 
P AR  0 3 39  0 

LO  73  J=1 , a 

PAP03100 

j.  1=2*  (ITM  1-  IL)*  J 

PAR03  1 10 

LTSAV  EJI1,1)=EL(J,1) 

PAR03  120 

LI5AV  2(11,  2)  = EL  (J,2) 

PARO  3 130 

CC  NT  J.NUE 

PAR03 140 
PAR03  150 

DO  a 3 L=  1 , N 

? AR  33  1 6 0 

DO  60  K=1,M 

PAR03  170 

IND£X=K*  (L-  1 ) *M 

? AR3J  10'; 

L ARRAY  (IT1  ,INDLX)  =EL  ( K , L) 

PARO  3 19  0 

CONTINUE 

PARO 3 200 
PA  3032 1 0 

12=2*  (ir:i  1-IL) 

PAR03220 

.1TSAV„  (12*  1)  =EM(  1) 

P AR  0j23  0 

;1iSAVE(I2*2)  = £.1  (2) 

P A RO  3 240 
P AR3J253 

DO  9 0 K = 1 ,3 

PARO  J2b0 

a arr  ay  ;ir  i ,kj  =lb  (k) 

P ARu3  27  > 

CONTINUE 

PARO  3200 
P AF  0J29C 

CALCJLATE  EK,  DM , DO , DP,  COST  SENSITIVITY 

PAR0330C 

non 
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F ILE: 


TjO 


11J 


120 


C 


PAF  FOR  TLA  N A 


CONVERSATIONAL  MONITOR  SYSTEM 


DC  19:  ICGUNT=1,3 
I N D 1 = - 1 

i N D 2=  N *IL  + 1*  :iCOJNT-  1)  *12 
I N D 3 = 3 

inj4=il*u  {icou:iT-i)*b 
JO  1 8 j I — 1 , N :i 
J=  I 

inj 1=1 nd  n a 

INC3=IND3*1 
JO  l.j  11=1,2 

INDEX *1 ND2-N+I 1-1 
DP  :i1)=JPSAVE  'INDEX  , IN  L3) 

CM  [1 1 ) = D M 3A  V a 'I  ND&X,IND3) 

DO  100  01=1,2 

J N D E X = I ND1  *J  1-  1 

DR  I1 1 , J 1 ) = UKSAVE  (INDcX,JNDEX) 

0 G N T I N U ^ 

JO=  COSA  VE(IN  C4-1  ,IND3) 

CALL  TR  NATB  JNA  ,NA,N,M,B,U) 

CALL  MMUL  ( N A , N A , NA,N,M,N, U,DK, «) 

CALL  MMUL  'N  A ,N  A,NA,N,.1,N,W,A,  BPA) 

CALL  MMUL  'NA  ,NA,  NA,M,M  ,N  , B,  BP  B) 

CALL  MMUL  'N  A , N A , N A , M il , M , M ,W  , C,  BPC) 

CALL  MMUL  ' NA,  N,  N,  MM,  M,  N,  U,  DP,  BD?) 

IE=  H (I-  1)  /N 

:o  = i*  ;j-i)/n 

IU=  1 *Mu  D (I- 1 ,N ) 

1 V=  1*  MOD  ;j-  1 ,N) 

CALCULATE  DK 

DO  110  K=  1 ,M 
DC  110  L=1, N 
KK=  1 ♦ (K-  1)  *N 
LL=  1*  [L-  1)  * N 

CALL  MMUL (N A, N A , N A , N ,N ,N ,DK,S1GBA  (KK,LL) ,*} 
CALL  TRACE  (N  A , N , W , TE) 

BPA  (K,L)  =B? A (K,L)  +TL 
CO NT IN  U& 

JO  IrO  K =1  ,M 
DO  120  L=  1 , M 
KK  = 1 ♦ 'K-  1)  * N 
LL=  1*  (L-1)  * N 

CA  LL  MMUL  ' NA  , NA  , NA,  N,N,N,  DK,  SI  OB  'KK,LL)  , W) 
CALL  Tr.ACE(NA,N,  M,TR) 

jpb  ;k,l)  =b?b  ;k,lj ♦ te 

C 0 N II  N JE 

IF  '.ICGUNT.  Ew.2)  aPA  :iE,I3)=BPA  'I  R,  1 5)  * EK  T [1  V,  I U) 
CALL  TRNATb  JNA  , N A , M , N , BPA,  *) 

CALL  MMU  L 'NA,NA,NA,N,N,M,W,EL,  VW) 

CALL  SAV2(N A,H A,M, N,B?A,UVW) 

CALL  SAVE  J NA  , N A,  M,  M,  B KB  , W) 

CALL  MLINi. w (N  A,H  A, M, N , W,  U Vh  ,CON D,IPVT , WORK) 


PAE03310 
? AE  03320 
PAR0333G 
P ARU3340 
PARO  3 350 
P AR0  3 36  0 
PA  a03  3 70 
PAR03  3B0 

par  03390 

PAP.03400 
P AR  w3  4 1 0 
PA  RO  3 420 
PARO 3 4 30 
P A R 03  44  0 
PAR0345C 
PAR  03  460 
PARO 3470 
? AR  03  4 80 
PAR03490 
P AR 03500 
PARO 3 5 1 0 
P AR03520 
PAR03530 
P AE03540 
PAS03  550 
PARO  3 560 
PAR03  570 
PARO  3 580 
P AR03590 
PARO  3 60  0 
PAR  036  10 
PARO  3b20 
PAR03b30 
PAR03640 
P ARO  3 650 
P AR  03  06  0 
PAR03670 
? AR  J3680 
? ARO  3b90 
P ARO3  700 
PARO  37  10 
PAR03720 
PAROa  73  0 
PARO  3740 
PAR  03  750 
P AR03  7 1>0 
P AF.03  77 C 
PAP.  05780 
? ARU3790 
PAR03H00 
P ARO Jd  1 0 
PAR Ua  82  0 
? ARO  3d  30 
? AR  03  8**  0 
P AR03B50 
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FILE:  PAT  FORTRAN  A 


CGNVERS  ATIGNAL  IGNITOR  SYSTEM 


C 


c 


1 JO 


140 


CALL  ThNATB  ;NA,NA,f1,  N,3KA,W) 

CALL  llM’JL  ' N A , N A,  N A , N , 3 , 4 , h,UVN,V) 
CALL  A A JO  'U  A ,N  A,  N A , K , N , V , VW  , VW ) 


-ALL  SAV-(N  A,N  A,  .1,  N.BKA  ,W) 

CALL  SAVE  ( NA  , NA,  4,  &,  3K3,  UVW) 

CALL  «LINCu(H A,N A,M,N,  UVW  , W,CGN D,1?VT , WORK ) 

IF  (ICOUNT.  E 3)  B PB  (I  E ,1  S)  =B  PB  (IE, IS)  + EKT(IV,1U) 
CALL  HUL  (NA,NA, NA,N ,4,4 ,BPB,W,UVW) 
call  SAVE  'NA  ,NA,a,?l,BKB,W) 

CALL  4LIN-  J'NA,NA,M,N,  W,UVW,  COND,  IPVT.KORK) 

C«LL  TRNAI B ' N A , N A,M,N  , 3KA,N) 

CALL  K MU  L JNA,NA,  NA,N,M,M,  W,UVW,V) 

C AL L MA  JL)(NA,N  A,  NA,M,  N,VW  ,V,VW) 

CALL  TRNATB  (N  A , N A,  N , N , A , V) 

-ALL  JU1UL  ',NA  ,NA,NA  ,N,  N ,N  ,DK,  A,  UVW) 

CALL  MMUL  ( N A , N A,  N A , it  , N , N , V , J VW  , W ) 

CALL  £ ADD  INA  ,NA,NA  ,N  , N ,W  , V U , U V W) 

Du  13 0 K = 1,N 
DO  130  L=1,N 

KK  = 1 ♦ IK-  1)  *N 
LL=  1 * (L-1)  * N 

CALL  MilU  L J NA, NA  , NA  , N, N , . , LK,  SlGA  (KK,  LL)  , W) 
CALL  TRACE (N A,N , W,TR) 

uvw  ;k,  l)  =uvu  'k,  L)  ♦ tr 
CONTINUE 

IF  JICOUNr.EQ.  1)  UVW  'IR,I3)=UVW  [lb,  IS)  ♦ ekt;iv,iu) 
CALCULATE  Dil 
DO  140  K=  1 ,« 

K K = 1 ♦ (K-1)  *n 

CALL  21HUL (N A,  NS,NA, N, N , N, DK,SIGBC  (KK , 1 ) ,W) 
CALL  ?F  ACL  ( NA  f N,  W,  T6) 

3 PC  (K)  = 3 PC  { K ) 43  DP  (K)  *TR 
CONTINUE 

CALL  SAVE  'NA  ,N  A ,N,  N ,B  KB  ,U  ) 

CALL  SAVE  'N,M,N,i1,  BPC.DM) 

CALL  LIN&J  IN  A,  4,W  , DM, COND,  IPVT,  WORK) 

u ALL  SAVE (N, N, N, 1M,BKC, W1 ) 

CALL  SAVE  (NA,NA,  N,N,BKB,W) 

CALL  LI  NEu  (N  A,  fl,  W,  Ml  , CON  D,IP  VI  ,WORK) 

CALL  XflUL  JNA  , N , N , fl  M,  N , N ,3  PB  , U 1 , W 2) 

CALL  jA  V l ( N A ,N  A, N , N, BK  B, W) 

CALL  LI [NA,N#W  ,W2, COND, IPVT, WORK) 

CALL  MA  JD  ' N , N , N , N, AM,  DM, m2,  DM) 

CALCULATE  DG 

CALL  MMU  L J NA  , NA,  NA  , N,  N,  N,  DK,  SIGC,  K) 

CALL  T L AC  L ( N A , N , * , Tr. ) 

CALL  TRNATB  ' NA  ,3.1,  N,SM,C,W  3) 


? AR  j 3 8 6 U 
PARO J870 
P ARO  3880 
PAR 03 390 
P ARO  3900 
PAR  Oj 91 0 
P ABO  39 20 
PAR  03  930 
? ARO  3 9 40 
P AR  03  95  G 
PARG3960 
P ABO J 97  0 
PAR  03  980 
P ARO  3 99  0 
PAR  04  000 
? ARO  40  10 
? AR  04  u20 
? A RO  40  30 
P AR  04  04  0 
PARO  4050 
P AR04  06  J 
PAR04070 
PARO 4080 
P AR  04  090 
PA  BO  4 100 
P AR  04  1 1 0 
PARJ4  120 
P AR 04 130 
PARO  4 140 
P AR 04  150 
PARO  4 160 
PAR04 170 
PAH04 1 80 
PAR04  190 
? A R 04  2 00 
PAR04210 
PAR  04  22  0 
PARO  4230 
P All  04  24  0 
PAR 04250 
PAR04  260 
PAR04270 
PARu  4 28  0 
PAR  04  290 
PA  RO  4 JOO 
P AR'J4J1  :• 
PARO  4 320 
P AR04  33c 
PAH0434U 
P ARO  4 350 
PA  n04360 
P ARO 4 37  0 
PARO^JdO 
PARO  4 390 
P ARO  4 40  > 
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FILE 


F O.-.Zl 


CONV  ERSATIQNAL  SCSI  IQ  a SYSTEM 


C 

C 

c 


c 


c 

c 

c 

c 


c 

c 


# 

c 

1 to  0 


CA  LL  MMU  L ( N A , N A,  N,  MM,  N , N , DK,  C,  « 1) 
v.  ALL  MMU  L ( fi  A , N , N A , ML,  MM,  N , n 3 , Vi  1 , W) 

CALL  MMU  L I MM, N, NA,  MM,  MM,  W,  W3,QP,  V) 

J G = D G + JT W ( 1 , 1)  ) / 2.  ,‘Dj  V(1,1) 

Cn ll  T&:JATb  ;N,anis#aa,BPc,w3) 

CALL  MMUL  : MK , :1 , N A , Mil , MB  , N , W3  , La  , W ) 

CALL  T SNA  13  JN,  MM,  N,MM,  BKC,  U 3) 

c all  a«UL  'an  ,n  ,n  , mm, mm,  n,w3 , on,  v) 

DG=  EG*  ( A ( 1 , 1)  «■  V (1  , 1)  ) /2 . 0 JO 
CALCULATE  UP 

CALL  TENAT13  'NA,N  A,  N,N  , A,W) 

CALL  KMUL  (N  A ,N  A , N ,MM  , N , N,  DK,  C , W 1) 

CALL  MA  DD  (N  , N,N, N, MM,  Vi  1,  DP,  W 1 ) 

CALL  3MUL  A,N  ,N,f!M,N,N,H  ,W  1 ,h2) 

JO  15  0 K=  1 , N 

KK-=  1 + ;K-  1)  *N 

CALL  MMUL  («  A,  N N A,  H A , M , N , N , D K ,S IG&C  (KK,1 ) ,W) 
CALL  TRACE  [tih ,N,W,TE) 

CP  (K)  = W 2 ( K)  +TR 
CONTINUE 


CALL  TRNAT3  ' N A , K A , N , N , 3PA , W ) 

CALL  aau  L'NA,  M,  N,  ilM,  N,  N,  * , EM  , W 1) 

CALL  MADD(N,N,N, M,MM, DP,W’1 ,DP) 

CALL  TfcNATB  ' NA  , NA  , N,  K,  3KA,  M) 

CALL  MMUL (NA,N , N,MM,N ,N, W,DM ,W1 ) 

CALL  MADD  J2J,N,N,  N,  MM,  DP,  W1  ,DP) 

I?  JIL.UL.IT'll)  GO  TC  160 

CALCULATE  COST  SENSITIVITY 

CALL  TSNATB'N,  1,  N,  1,  HiESO,  M3) 

CALL  MMUL  (N  A,N  ,N  ,MM,N  , N,UVW,  XZERO,WOH  K) 
CALL  MMUL  1 1 , H , NA  , MM,  MM  , N , W3,  WORK,  W) 


CALL  TR  N AT  B JN,N,  N,MM,  DP,W  3) 

CALL  MMUL  ' Si  , N,  N,  MM,  MM,  N,  « 3,  XZEF.C,  V) 


C3XSEN-W  '1,1)  /2.  0D0  ♦ V C 1 , 1)  ♦ PC 

*RI1E(KOUT,900)  CSTSEN 
It  J ICGU  NT.  Lc«  1 • A NO.  I.  EQ.  J) 

IF ( ICOUNT. .AND.I . £U • J) 

It  [ICOUNT.cQ.  I.ANP.I.iQ.J) 

I F ( IC  OU  N T . Ev!  • 3 . A N D . I . LQ  . J ) 


K L=  KL ♦ 1 
K L= KL»1 

ALL  SEN  '.KL)  =C3TS  EN  * S I G A 'I  ,J) 
S ti-SEN  (KL)*C5I3EN*3IGB  (I  ,J) 


CONTINUE 


PAR  0**  4 1 0 
?A?.04  4^0 
P A E 0 4 4 3 0 
P ASU4440 
PAL  04450 
P AaO  4 460 
? AH  U 4 4 7 0 
PAS 04 480 
P AaO 4 490 
PA  SO  4 50  0 
P ASC  4 510 
PAP.  04520 
? AHO  4 530 
PAS  04  540 
PAS04550 
? AS  o4  56 o 
PAS04570 
? AH  04  58  0 
PA  SO  4 59  0 
? Aou4  oOO 
PA  a 04 61  J 
P A HU  4 6 20 
PAS  04  o3  0 
P A SO  4 640 
P AH  04  65u 
PASO  4 660 
? AR 04670 
PA  a 0 4 60  0 
P An04690 
P A n 0 4 700 
P A SO  4 7 10 
PAH  04  72  0 
? A HO  4 7 30 
P AR0474 J 
PA  SO  4 7 50 
P AH  «/4  7o  0 
PA  SO  477  0 
? A a 0 4 78  0 
PAH 04  790 
PASO  4 80  J 
PAH  04  81  0 
? A SO  43  20 
P AS  0433  ^ 
PA  HO  48  40 
P AH  04  650 
PARU  43  60 
? AH04370 
P Aa  04  88 0 
PA  SO  4 89  0 
r AH  04  90  3 
? A h 0 4 9 10 
? AH  0-4  92  J 
?ASt0493u 
? AR04  94  : 
PA  SO  49  5 J 


n n n r;  « > n n n n n n n n n 
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• ILu< 


i?  AE- 


? 0 . T R A H A 


CONVERSATION  AL  MONITOR  SYSTEM 


J A V 3 DK,  OP,  DM,  DG 

JJ  17  ID—  1,2 

INDEX  =IND2*ID-1 
DPS  AV E (IN  OCX,  IN  L3 ) = DP  ( ID) 

DMSAV  I (I  NDEX,  I ND3)  = DM  (ID) 

LO  1 7 3 J D=  1 , 2 

JNu£X=I  UDUJD- 1 

LK3AVE  (INDEX,  JNDEX)  = UVW  (ID,  JD) 

17 J CONTINUE 

DGSA  Vi  (IND4,  IN  E J ) = DG 

180  CONTINUE 

19  0 CON  TIN  JL 

CALCULATE  G ( T)  , GV  Eh  WAITING  G (T  ♦ 1 ) 

SC=. 9 8 7o  543eQ9876544 LO 
CALL  M3CALZ  (N,  N, MM, SC, XT) 

CALL  TR  NATE  (N  ,N  A,rt  ,HM,B  KC  ,V  ) 

call  mmjl  (na,m,n,mm,mh,k,v, em,w2) 

CALL  MMUL  (N  A , N A,N  A ,N  ,N  ,N  ,EKT  #S  1GC,  W) 

CALL  TRAC  £ ( N A , N,  A,  TR) 

CALL  TK  NATE  (N  A,  N A,  N,  Mil,  C,W) 

CALL  MMU  L (NA  , NA  , NA,N,MM,  N,  W , EKT,  V) 

CALL  MMUL  (NA,  NA,  N, MM ,MM , N , V, C , W1  ) 

CALL  MAUL  (NA  , N , N A , MM  , MM  , N ,*  ,PT,V) 

31'=GH-V(1,  1)  *-(Wl  (1)  +H2  (1)  ♦TR)/2.0D0 
CALL  JjF  (N  A , N ,N  , N , MM  , v , X T , W 1,WCRK) 

C ALL  Me -?  (NA,M,N,M,MM,R,UT,W2,  WORK) 

UT=GT*  ( - 1 ( 1)  +W  2 ( 1)  )/2.  0D0 

SAV^,  GT 

GTSAVE(ITI)  = GT 

CALCULATE  P(T),  OVERWRITING  P ( 1 + 1 ) 

CALL  TRNAT3  (N A , N A , N , N,  A,  W) 

CALL  MMUL  (NA,NA,NA,N  ,N  ,N,EKT,C,V) 

CALL  MAUD  (NA  , N,  NA,  N,  MM,V,PT,  V) 

CALL  MMUL (N A, N A, N, MM,N,N,W, V ,W 1 ) 

CALL  T ti  NATb  (NA,NA,  M,  N,3KA,W) 

CALL  MMUL  (NA,  M,  N A,  MM ,N ,M , W, EM, V) 

Crt  LL  MMU  L (NA  , N,N  ,MM,  N,N,  W#XT,  W 2) 

CALL  MS  UB  (NA,  N,N,N,MM,  V , K2  , *2  ) 

DC  200  K- 1 , N 

K K = 1 ♦ (K-1 ) *N 

CALL  MilUL  (N  A , NN  A,  NA  , N ,N  , N , EKT,  S IG  AC  (KK,  1)  , W) 
CALL  TRACE  (NA,  N,W,TB) 

P C (K)  = W 1 ( K ) ♦W  2 ( K)  «-TR 

20C  CONTINUE 
C 


s'  A RO  4 9 o 
PAR  04  9 7 „ 
PAE0498 j 
? ARb499 
PARO  500  o 
PAR05010 
PAR 05 02  0 
? ARO  50  30 
PAR0S04  0 
PAR05050 
? AR  0 j J 6 j 
PARO 5 070 
P AR  v>  5 v 8 1 
PARO 50 90 
? AR05 100 
PAR  05 1 1 0 
PAR05  120 
PAR  05 1 3 0 
PAROS  140 
P AR  0 5 1 5 C 
PAROS  IbO 
P AR05 170 
PAt<05  180 
? A H 0 5 1 9 0 
PAROS  20  0 
PAR05213 
P AR  0522  0 
f AcO  5 230 
? AR  05240 
f A ci  0 5250 
P AR  05  26  0 
PA  c.  05270 
P Anu 5 L 8 0 
PA  R05  2^0 
PARO  5 300 
PAR0531 0 
P AR05320 
? AR  05 33  0 
PA n 05340 
P ARj5  35'j 
P A R 0 5 360 
PAR05  370 
PA  R 05  380 
PAS05390 
P AR 05400 
PAK05410 
? AR  4 5 42  0 
PARU5430 
P ARc5440 
PARO  545u 
c AR05  46  0 
PA  R 054  70 
P ARO 5 480 
PAR  05490 
P A R 0 5 50  0 


o n n n r<  n 
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?IL~:  ? A F 


F OR T aA  N n 


CON  VEF-d  ATIGN  AL  MGNIIOR  SYSTEM 


GAVE  PT 

I 4=  (IT-  1L)  *M 
PTSAVE  [14-  1)  =pr  I 1) 

PI5AV£.(I4)  = PI  (2) 

CAL«-JLA'i-  K 1 T)  , OVERWRITING  K (T+  1 ) 

CALL  IT.  NATO  [NA  ,NA,H,  N,  dK  A,  W ) 

CALL  MMJL  [NA,NA,NA,N  ,N  ,H,W  , EL,U) 

CALL  llj  ° [NA  , NA  , N A,  N,  N,  EK  T,  A,  « , V) 

CALL  JADD  (NA,  U A,  NA,N  ,N  ,U,h  ,U  ) 

OC  215  L = 1 , N 
L 0 210  K=  1 , N 

KK=  1 + !K-  1)  *N 
LL  = 1 ♦ (L  -1 ) *N 

s.  ALL  M MU  L [N  A ,N  N A , N A , N , N,  N , ZKT,  S1GA  [ KX,  LL)  , V) 

CALL  T R AC  Z [ N A,  N,  V , T R) 

* (K,L)=w  l*,L)  + U (K,L)  + TR 

INDZX=K*  (L-1) *N 

A?. .AY  (111  , IN  DZX)  =W  (K,  L) 

21  J CONTINUE 

CAL-  SA  V E ( NA  , N A , N , N , W,  EK  T) 

220  CONTINUE 

? LC'T  K 

uo  tio  1=1  ,a 

DC  2 JO  J=1,N 

= j + (i-i)  *u 

IP(INDcX.LE.9)  ITOP  (3 , 1 ) = I N (INDEX) 

I?  [INDEX. GT.3)  ITOP  J 3# 1)  =1 3L A NK 

a sic  .1  ( i)  = 1 1 

CALL  TUPLT  (NPTS  ,1 EG  Y ,ARRA  Y [1,  INDEX)  , N ? Td,  I TOP  , NS  Ytt  , XMIN, 

♦ XM  A X , YMI N , YM A X, YdF  ,NGR  IDH  , N LG  , MS  CALL  , M AXEd  , IXY  ) 

230  CONTINUE 

CALCULATE  STATL  XS 

X d A V d ( 1,  1)  *XZ£RO  ( 1) 

XSAVE  (1  ,2)=XZERO[2) 

XS  [ 1 ) = X 2ZK 0 (1) 

XS  (2  ) = X Z E 30  (2) 

DC  250  1=1,10111 
JO  240  J-1 ,M 

I N DLX=  2*  1-2  + J 

ZTS  [J  , 1 ) =LTSA VL  [I  ND  EX  , 1) 

LOG  ( J , 2)=LTdAVE(INDZX,2) 

2 40  CONTINUE 

CALL  1 1UL  [NA  ,N,M,MM,  M,  N,LTS,  XS,  XS1  ) 

11=1+1 

MTS  (1)  = MT SA  V E (I I - 1 ) 

HTS(2)  = MTS  AVE  [II) 

CALL  MAD  C [ M , M , M , M,  h.M,X  SI  , MTS,  X J 1) 


? ARO 5 510 
PAROS 52 5 
? AEG  5 530 
PAR05540 
PARO  5550 
P AR  u5  56  O 
PARO  5570 
P AEj558U 
PAE05590 
PASG5600 
PAR056  10 
P AE05b20 
PAR  05  b3  0 
PARJ5b4J 
? AR  - 5 6 5 j 
PAR 0 5660 
P ARO  5 o 7 0 
PAR  05680 
? AKO  5o9  0 
PAR  05  700 
PARO  57 10 
P AR  05  72  0 
PAH05730 
PAR  05  740 
PARO  57  50 
P AR057b0 
PAR  05  77  0 
PAR05780 
P AR05790 
PAE05  800 
PARO 58  10 
PAR  0582  0 
PAR05830 
P AR  u5  84  j 
PAR 05850 
PAR  05  86  0 
PAR05870 
? ARO  5 88  0 
PAR 05  89  0 
PAR05900 
P AR0591 y 
PAR0592C 
P ARbS  93  C 
PAR05440 
PARJ595C 
PAP.  05960 
PAR05970 
P Ah  05  98  0 
?Ah05990 
? Ah  Ob  uC1 C 
PARJbO  10 
? AR  Ob  02  G 
PAR0bj30 
P AR06040 
PARObOSO 
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TIL3:  P/u\  FOR  IP. AN' 


CONVERSATION  AL  M C N 1 1 Q F 3YSI-M 


U SAV  i.  (I , 1)  =X31  (1  ) 

usa ve  ;i,2j=xs  i (2) 

call  :i:iUL  (na  ,m,«,;im,n,m,  b,  xei,  xs2) 

CALL  MOLD  (N  ,N  ,N  ,N  , MM  ,XS2  ,C,XS2) 

CALL  MhU  L (NA  , N , N , il  M,  N,  N,  A,  X S,  X 3 1) 

CALL  MADE  (N,  N,N,  N,  MM,XS  1 ,XS2,XS) 

X S AV £i  (1+1  , 1 ) =X  5 ( 1 ) 

X GAV  o (I  + 1 , 2)  = X J (2 ) 

25 L CONTINUE 

PLDT  SI  AT-  TRAJECTORY 

Du  26 J J = 1,1* 

NS Y M (1 ) =24 

IF  (J. Lis.  9)  I TCP  {9,  2)  = IN  ( J) 

IF(J.GT.9)  I T 0 ? ( 9 , 2)  =1  BL  A NK 

CALL  Til  PL  I (NPTS,  IRGY,XSA  VE  (1  , J)  ,NPTS  ,ITOP  {1  ,2)  ,NSY'1,XMI  N,X(1AA, 
+ YMIN,YMAX,YSF,NGRIDH,NLG,t1SCALS,MAXES,IXY) 

2b J CONTINUE 


C P LOT  CONTROL  TRAJECTORY 

C 

X 11=  D FLOAT  (IT. 'll) 

Du  2 70  J=  1,  M 
NSYM  (1)=2  1 

I-(J.Li.l)  ITO?  (1  1 ,3)  = IN  (J) 

IF  [J  . ST.  9 ) ITOP  (1  1 ,3)  =1  BLANK 

CALj.  THPL  T { ITM 1 , I EG Y , USA Vt  ( 1 ,J)  , ITK 1 ,ITCP  (1,3)  ,N5YM,XMIN,XP1, 

♦ YM  IN  , Yil  A X , YS  F , NG  R I DH  , NLG , MSC ALE,  M AX  ES,  IX  Y ) 

2 70  CCNTINU  c 

C PLOT  GA-NS 

BO  28 „ 1= 1 , N 

DC  280  J=  1, M 
N 3 YM  ( 1 ) = 1 2 
I ND-X  =J  + (1-1 ) *M 

IF  (INDEX.  LE.  9)  IT  CP  (6 , 4)  =1 N ( IN  DEX  ) 

IF  (INDEX  .GT.9)  I TCP  (6,4)  =1  BLANK 

Ca  LL  THPLT  illil  1,IEGY,  LARRAY  (1  , INDEX)  , ITM1  , ITOP  (1 , 4)  , NSYM, 

+ X .11  N,  X il,  YMIN,  Y MAX  ,YSF,  NGSI  DH,  NLG,  MS  CALL,  MAXES  , 

♦ IX  Y) 

2 6C  CONTINUE 

C 

C PLOT  CORRECTION  TERM  fl  (T) 

C 

DO  290  J = 1,(1 
NSYM  (1  ) =1  3 

I F ( J . LE.  9)  ITO?  (3,  5)  =IN  ( J) 

IF  (J.  ST.  9)  ITOP  (3, 5)  =1  BLANK 

CALL  Til  PL  X (I  Till  , I2GY,M  ARRA  Y (1  ,J)  ,ITM1  ,ITOP  (1  ,5)  , NSYM  ,XMI  N,XM, 

♦ YMI  N,  YMAX  , Y SF  , NG  RIDil  ,NLG  , M SC  ALL,  M AXES  , I X Y ) 

29  0 CONTINUE 

C 

C CALCULATE  uOST 


?AF.0o06C 
? At  Lb  u7 0 
PAEObOBC 
P ARub  J 9 0 
PAROb  100 
PAfi'Jb  1 10 
PA F.  06120 
PAROb  13C 
? AR  Ob  1 4 0 
PAROb  150 
PAR  Ot  16  C 
PAROb  170 
PAFub 180 
PAR  06 1 90 
PAR06200 
PAR  0621  0 
PAS06220 
? AR 0623u 
PAR 06240 
? AR  Ob  250 
PAR06260 
PAR06  270 
PA  A0b2  80 
PAROb  290 
PAR  06300 
PAR06310 
P AR06320 
PAR0b330 
P &RG6  34  0 
PA  Ro  b 350 
PAR 06  36  0 
PAR063  70 
P AxiO  6 36  0 
? AR  Ob S 90 
P A RO  b 40  0 
P AR  06  4 K 
PAROb  420 
PAR.0643C 
?AR0b44  0 
PAROb  450 
PAR  0b4b0 
P ARO  b 470 
P AR36480 
PAR0b490 
P AR0b50c 
PA  RO  b 5 1 0 
? AROb  520 
PAR  Ob  53  0 
P ARO  o 540 
P AR  06  550 
PA hub  5oC 
P AROb 571 
? ARO  o SbO 
PAR  0 0 5 9 J 
P A t\0b  bC  J 


n r.  c r.  r.  n 
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FILE:  PAR  FORTSA  N A 


CCN  VERS  ATION  AL  MONITOR  SYSTEM 


XS  :u  =X3  A VE  (IT  1*1,1) 

X3(2)  = XSAVs(IT1  *-1 ,2) 

DO  J J : L=  1 , N 

L 0 3 00  K=1  ,N 

INDEX=K  + (L-  1 ) *N 
'J  (X  ,L)  =A  E F A Y (IT1  +1,INuEX) 
300  CON  TIN  0 E 

CALL  MO?  (NA,2,N,  N,MM,U,XS,W  1 , X 2) 
I 5=11 1*  N 
SUM=3.oi>3 
DC  310  11=  1 , N 
II5  = I5  + H 


P AHOb  6 1 " 
PAR<j6o2  J 
? A A0  b o 30 
PAE06b4O 
PAL0fao50 
P AR  06  66  J 
P A KO  b b7  O 
? AR  Cb  680 
?AROfab90 
P AR0b700 
PAR  Ob  71  0 
PA  ROb  7 20 
P AE  Ob  73  0 
PAR0674Q 
9 AR  06  750 


faj  .1=S'JM  +PISA  V E (II  5)  *XS(II) 

310  CONTINUE 

COST  (XL)  =0.5  DO *4  1 ( 1)  +3UM  +GTSAVE  (IT  1+  1) 

320  CONTINUE 

3C  = 1 . : D3/COST  (IT) 

CALL  „1SCALE(8,8f  1,SC,  HuLSEN) 

PLOT  COST 

NSYK  (1)  =10 

CALL  THPLT  (N  PTS  , IEG  Y , COST  ,N  PTS  , IT  GP  (1,6)  , NSYM,X  HI  N,  Xil  AX,  Y»  IN 
+ YSF,NGEIDH,NLG,HSC,  M AXES,  I XY  , NS  Y M ) 

WRITE  (KOUT  , 700) 

-RITE  (KOUT,  3 Jo)  (EEL  SEN  (10)  ,10  = 1,8) 

700  FORKAT(  IlIO,  27H  RELATIVE  COST  SENSITIVITY  ) 

003  FORMA!  (4026 . 16) 

900  FOR  MAT  ( 1H0,  1 OH  CSTSEN  = ,D26.1b) 

RETURN 

LAST  LINE  OF  PAR 
END 


PAR0fa760 
P AP.U6  77  j 
?AR0b780 
P AfiOb  790 
PAR 06800 
PA  ROod  10 
P)C R Ob  82  0 
PAR0b830 
P AR  06  84  v, 
?AR0b850 
YM  AX  , ? AR  Ob  86  C 
PA  R0b87G 
P AR06880 
PAR06890 
PAR0b900 
P AR  Ob  91 0 
P ARO  69  20 
? AROb  930 
PARO  6940 
P AR  Od95C 
?AR0b960 
P AnOb  970 


* 


